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CHAPTER 1 


INTRODUCTION AND DISCUSSION OF CAPITAL BUDGETING 


One of the most important recurring decisions for any economic 
unit> public or private,-is that of allocating its limited financial 
resources in a manner which best supports the attainment of its 
goals, Nearly always, such decisions must be made in an environment 
characterized by incomplete information, uncertainty, complex 
interactions among activities, imperfect capital markets, and many 
other complicating factors, The problem is compounded by the fact 
that most organizations in government and private business continue 
to perform their functions over a number of years, and must therefore 
consider the possible future impacts of their decisions. In fact, 

Le as often necessary not only to resolve those issues on which 
immediate action is required, but to integrate such current decisions 
into a.strategic plan which applies far into the future. 

During the past quarter-century, managerial economists have 
given considerable attention to this "capital budgeting" problem, 
and have greatly improved the methods used to deal with it. The 
theory of capital budgeting is by no means complete, however, and 
there remain many unanswered questions of practical significance. 

The development of techniques for constructing and solving mathematical 
models of complex decision processes has allowed explicit consideration 
of interactions among investment alternatives and other complicating 


factors. Such mathematical programming techniques have provided a 





more theoretically-sound basis for decision making than was previously 
available, and the computational efficiency with which they may often 
be solved shows great promise for the resolution of large-scale 
capital budgeting problems, 

This dissertation describes and comments upon several formulations 
of the capital budgeting problem which have appeared in the literature 
of mathematical programming, and presents an extended multi-stage 
model for the selection and timing of investment proposals whose 
future availability is uncertain. The model is developed in the 
context of pure and mixed integer linear programming, with particular 
attention given to the special structure of its constraint set. We 
then present an integer linear programming method designed to exploit 
special structures of this type, commonly known as "dual-angular", by 
decomposition into groups of smaller subproblems. (Such dual-angular 
constraint matrices also arise in a number of other applications 
not directly related to multi-stage capital budgeting.) The decomposi- 
tion method, implemented within the framework of a penalty-based 
zero-one integer programming algorithm, has enjoyed considerable 
success in reducing the effort required for solving a variety of 
test problems. A detailed discussion of this specific implementation 


and of its associated computational experience is also presented. 


iPeleomme Historiea. Perspective 


Prior to the publication of Lorie and Savage [{ 1955], most 


theoretical techniques for selection of investment proposals were 


| 
: 





concerned with the analysis of individual projects, Acceptance or 
rejection of any given opportunity was based mainly on the value of 
some measure of merit, which was calculated with limited consideration 
of physical and budgetary interactions with other opportunities and 
the current operations of the Sigaaye Such a procedure can result in 
an optimum choice of projects only if all those under consideration 
are completely independent of one arSlalne ae This precludes such 
commonplace interrelationships as competition for the same scarce 
resources (wealth, manpower, customers, etc.) or the sharing of costs 
for new facilities required by two or more projects. 

A classic example of such techniques for evaluating individual 
projects is the payback criterion, Using this approach, a proposal 
is deemed acceptable if its total earnings meet or exceed the required 
initial capital outlay within a specified period of time. The 
determination of the "payback period" is rather arbitrary, with 
management often requiring that those projects which it considers 
more "risky" than others be repaid in a shorter period of time. In 
addition, different types of investments are frequently assigned 
different basic payback guidelines which are then "risk-adjusted", 
Some of the disadvantages associated with this approach are: (1) cash 
flows (positive or negative) which occur after the specified payback 
period are completely disregarded in the evaluation; (2) the salvage 
value of a project which may be terminated beyond its payback limit 


is not considered; (3) the value of a dollar received at any time 


th ea ee ae aera 
ar: Dean [1951} and Klevorick [1969] for additional discussions, 


this has been discussed by Lorie and Savage [1955], Hirshleifer [1958], 


Weingartner [1967], and Klevorick [1969]. 
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during the payback period is considered to be a constant, even though 
the value of money to the firm may vary within that period; (4) if 
different payback requirements are levied on different projects, there 
arises the situation wherein a dollar received from project A after 
its payback period has expired is given no value, but the same dollar 
received from project B at the same time is assigned a positive 
utility; and (5) the criterion provides little guidance when budgetary 
constraints are imposed on several periods. 

While not advocating payback as a criterion for selecting capital 
investments, Weingartner [1971] has discussed in detaii its apparent 
attractiveness to businessmen. Payback was presented variously as a 
measure of rate of return, as a form of break-even analysis, as a 
measure of the "liquidity" of a capital asset, and as a measure of the 
rate of resolution of uncertainty. Finally, it was concluded that 
payback was an oversimplification in each of the above cases, but that 
further study of its popularity might be a prerequisite to the develop- 
ment of superior alternatives. 

Another well-known technique for evaluating individual projects 
isp Ehe internal rate of return rule. This rule requires the calculation 


Bor Jeachepro jectuor thaterate Mreswnichewould Gausesthesproject S—cash 


Pd 


flows over future years to sum to zero if they were first discounted 


by xr. That is, a solution, r, is sought for the polynomial equation 
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a a a 
2 i 
ey a oe ae SO eo 
i hoe 4 T-1 4 
(Ler) (Lr) 


where a. is the net cash flow associated with the project in period ig, 
The procedure then requires that the proposals be ranked in order of 
decreasing internal rate of return, and that all those with rates exceeding 
a predetermined PHefection rate! iets. “cost of@eapital”) be wacaepted. 
This method suffers from several shortcomings: (1) the internal rate 
of return as defined above may not be unique, or the only roots of the 
polynomial (P) may be complex; (2) the cash flows in every period 
are given the same relative value in calculating r, even though the 
relative value of money to the firm may vary from period to period; 
(3) the "cost of capital" is an extremely elusive figure whose determina- 
tion has received much attention in the financial rena comeee and 
(4) the selection criterion provides insufficient guidance when the 
choice of projects is restricted by constraints on total cash flow in 
several periods. 

The net present value rule is similar to the internal rate of 
Meeurt rule excepesemat the former's discount rate is externally- 
supplied (often by a measure of the “cost of capital") instead of 
being determined irom the values’ of the cash flow components. In fact, 
the applicable discount rate may vary from one period to another when 
Gomugethe former ule mwhereasethe Pattereuses #amunlfOrm—erdte. nis 
allows for explicit use of information degarding future financial 
Euends, ‘owever, “Che =titm is still faced™with the~difticult task oe 
determining the proper discount factor for each period. Under the 


assumptions of a perfect capital market and complete independence 


among projects, use of the borrowing rate for discounting and selection 


"See Hirshleifer [1958] or Klevorick [1969], for example. 





of all projects with positive present values will lead to a solution 
which maximizes the net present value of the firm. Unfortunately, 
relaxation of either of these ale Peet 2 assumptions requires modifica- 
tion of the selection rules and may well render the rules non-optimal. 
In particular, if multi-period budgetary constraints are imposed, it 
becomes theoretically impossible to determine the appropriate discount 
rates and ine aforementioned selection rules would#eadi even if the 
rates were available. (For a detailed discussion of the problems 
involved in searching for the proper discount Fates) =the interested 


reader is referred to Hirschleifer [1958].) 


1.2, The Capital Rationing Problem 


Lorie and Savage [1955] presented a capital budgeting model 
designed to overcome some of the limitations of the then generally- 
accepted internal rate of return criterion for project selection, 

TO CmpeObLen wasmtO.Sclecuea POLLLOULO OL invesCtene projects wiien 
would have maximum total present value, subject to upper bounds on 

total expenditures in several periods and an exogenously-determined 
ValUe@:Or the fimm) Ss cost off capital an @ath period. Thus, rather 

than evaluating individual projects on their own merits and making 
independent investment decisions, the objective was to make a concurrent 
selection which explicitly considered the budgetary interactions of 

the evailable projects. Assuming that all cash flows were known with 
certainty and that the projects were mutually independent, Lorie and 
Savage were able to make some progress toward their goal when budgetary 


cee Dean (65 1] - 





constraints applied in only one or two periods and fractional invest- 
ments were allowed. Their iterative method was a form of "seneralized 
Lagrange multiplier" technique, as discussed by Everett [1963]. 

In a highly significant 1962 doctoral dissertation, Weingartner 
[1967] showed that the Lorie-Savage problem could be formulated as a 


linear program as follows: 


(LP) maximize Ze be 
© Jd 
J 
subject to La,.x, SM, for Sev eeee. T. 
O =< x7 L toy al ty 
-*j;- , 


where 
=F 25 the level Of panacea tioned project iy 
De is the net present value of project j, 
aE is the gross expenditure required for Piso JCC Came 1 


time period t, and 


Me is the spending limit which applies in period t. 
Recognition of this formulation allowed application of the powerful 
theoretical and computational techniques of linear programming. In 
particular, Weingartner presented an extensive analysis of the economic 
interpretations of duality theory as applied to (LP) and various 
extensions. 

The extensions to (LP) which were discussed included a change 


in the. objective to maximize the worth of the firm at some future time 


(the “horizon"), and allowances for borrowing and lending under several 


1 





types of capital market imperfections. Although some types of invest- 
ment opportunities are highly divisible and may therefore be undertaken 
at levels corresponding to fractional values of their associated 
decision variables (e.g., borrowing or lending), most capital budgeting 
decisions are of the accept-reject variety for which indications of 
fractional participation have little or no meaning. By appending to 


(LP) the additional constraint 


(*) x. = QO or 1 mes aes 


one may exclude the possibility of obtaining such indications for those 
projects belonging to the set S&S. 

Also, as Weingartner pointed out, this integer linear programming 
formulation can be used to express various types of project inter- 


dependencies by use of additional constraints. For example, the constraint 


x ne x, S l where Kk) 2 .GesS 


together with (*) indicates that projects k and £ are mutually 


exclusive, and 
x - x <O where m, n€& 
together with (*) indicates that acceptance of project m requires 


acceptance of project n. Unfortunately, the solution of an integer 


linear program is a much more difficult task than that of the corresponding 





linear program in which the integer restrictions are removed; furthermore, 
the most successful (enumerative) techniques for integer linear program- 
ming are not readily amenable to duality analysis or sensitivity analysis. 
Baumol and Quandt [1965] expressed SSS) aeheceng of 
Weingartner's formulation of the capital rationing problem. They con- 
sidered the most serious shortcoming to be the previously-mentioned 
difficulty of determining an appropriate discount rate for each period, 
and indicated that other writers had unjustifiably glossed-over the 
problem, In addition, they were dissatisfied with the fact that 
Weingartner‘'s model did not allow net cash inflows from selected projects 
to be used in the same periods for augmenting the budgeted amounts. 
Baumol and Quandt argued that a firm should be able to reinvest such 
funds, and that it should be concerned with maximizing the utility of 
the funds withdrawn from its portfolio, rather than with maximizing the 
present value of that portfolio. They further claimed that such an 
approach would have the additional advantage of obviating the need for 
determining discount rates for each period, and proposed the following 


' model: 


maximize pe U. We 
te 
subject to ere ee ong 12a f Orc lye eee 
t 
x, 20, for all j, 
W >O0O for ail. vt 
t— 3 3 





where Ue is the utility of one dollar of withdrawal in period t, 


We is the amount withdrawn im period t, and ae is the net cash 
flow from project j in period t.? 
Weingartner [ 1966b } responded to the Baumol-Quandt paper with 

an admission of the difficulty involved with discount rates and a 

defense of his decision not to allow reinvestment of earnings. He 

also pointed out several faults in the Baumol-Quandt model, and suggested 
a third model which sought to maximize dividend growth. Following this 
exchange, several other papers appeared with suggestions on formulating 
an appropriate objective function for the capital rationing problem. 

It appears, however, that the controversy remains unresolved, and quite 
possibly may never by completely settled in a way that is both theoretically 
sound and computationally tractable. Meanwhile, advocates of programming 
approaches to capital budgeting have tended to choose particular objec- 
tive measures (recognizing their imperfections) and to proceed to 

develop models and techniques which can improve current practices. The 
most widely-accepted objective criterion is that of maximizing total 


Detepoesent value fronmmeite: projects) selected) and @that iiss the "meastme 


which will be used in the remainder of this study. 


1.3. Capital Budgeting with Borrowing 
Before proceeding to a dicussion of the incorporation of risk 


in mathematical programming models and to the presentation of our 


proposed multi-stage model, we should first show the extension of 
The authors stated that the use of a non-linear utility function would 
add nothing to their argument. 


searlecon [ 1969} 


Lusztig and Schwab [1968] , Mao [ 1969}, and Bernhard 
[1969]. 


? 
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Weingartner's deterministic formulation to allow for 


borrowing of funds, 


This capital rationing model can be readily altered to allow the firm 


to borrow funds under various types of capital market conditions. 


The 


budgetary constraints remain in the model, but are now interpreted as 


representing internally-generated funds which may be 
cost from external sources. We can also assume that 
any period may be lent out at the prevailing lending 
which may differ 


from the borrowing rate. Assuming 


supplemented at a 
surplus funds in 
rate of interest, 


unlimited ability 


to borrow and lend on one-period contracts at constant rates and 


3 


i> respectively, and using ip for the discount factor, the model 
becomes: 
we “ie 
maximize Lb x, - ind ? gee : et ? 
j t (1+ i,) t (1 + ip) 
subject to d, aojX, 7 Uy + Vy <M, , 
J 
Le Sopa ey) een © es Ey 
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where ui. and Vv, are the amounts borrowed and lent, respectively, 


i period — te 
We can introduce various market imperfections by adding additional 


constraints to the above formulation. For example, the provision for 


Ly 





unlimited borrowing can be replaced by upper bounds, B on the amounts 


te 


borrowed in each period: 


Such restrictions might be apoio to a division of a firm by its home 
office, or may arise for the entire firm due to liquidity considerations 
or limitations imposed by lending agents. 

Another realistic provision we might make is for the borrowing 
rate to be an increasing function of the amount borrowed. This is 
easily accomplished in any period by replacing u, with variables 
Wie associating a different interest rate with each value of k, and 
placing an upper bound on the amount that may be borrowed under each 
rate. This extension results in a linear program with a separable 
convex objective, which can be readily solved with the simplex method. 


Weingartner [1967] has also extended his basic model to consider the 


amount and timing of equity financing. 


1.4. Chance-Constrained Programming Formulation 

Up to this point, we have been concerned only with the formulation 
and analysis of the deterministic capital budgeting problem. We have 
assumed thet the decision-maker knows with complete certainty what 
projects will be available for selcction, what profits and cash-flow 
patterns will be associated with thesc projects, what limitations will 


be applied to cxpenditures and borrowing, and what the prevailing rates 


le 








of interest will be during that portion of the future with which he is 
concerned, Although the solution of a problem under these aaccmer tone 
can provide valuable insight into the implications of various constraints 
and the financial and RAI interactions among projects, “real world" 
dé€Cisions requine) The incorporation of the firm's attitude toward risk -= 
the possibility that aval agentes may not turn out as well as expected. 

In order to incorporate this concept of risk into the analysis, 
one must first identify those factors which can significantly affect 
the solution when they are varied within their ranges of possible values. 
The next step is to estimate probability distributions on these most 


iG 


sensitive variables’ , and to set all others at nominal (perhaps most 
likely, or mean) values. One can then employ a measure of the desirability 
of a project portfolio based on the expected results and the attendant 
risk, and proceed to solve and analyze the problem. 

Many different methods exist for decision-making under risk, but 
the two which have received the most attention in the capital budgeting 
literature are the expected-utility approach and chance-constrained 
programming. Maximization of expected utility has been a popular 
objective among authors in the related area of portfolio selecrten sm 
and has been applied in recent years to capital budgeting by Hillier 
[1969] and Klevorick [1969]. Its mane ahOmmrel ic tias Vyssh esas ts 
complicated utility functions (eeubiee exponential, etc.) which arise, 
and in the amount of work necessary to adequately determine these 
functious. The chance-constrained programming approach seeks to avoid 
these difficulties by using a simpler objective function and incorporating 
‘see Hillier [1963] and [1965]. 


evar fomiez [1959]. 
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risk-aversion into the constraints of the problem. This is done by 
requiring that any feasible selection of projects have a probability of 
at least O, of satisfying the ian constraint.7 Although several 
types of objective Se bee been proposed for chance-constrained 
programming, the most common one is to maximize the expected value of 
the chosen measure-of-merit, such as net present value. ; 
Assuming a long-run perfect capital market, Naslund [ 1967, 1971] 
presented and discussed a chance-constrained capital budgeting model 
in a manner which closely paralleled Weingartner's deterministic 
development. He showed how chance-constraints led to the requirement 


o ° es os t @ e e e 
for a specific financial reserve, or "cushion", in each period, with 


I 
the amount of that reserve depending on the amount of risk considered 


acceptable. Naslund also developed acceptance criteria for projects 


and considered the effects of changes in interest rates and variance 


of returns. The model -- a direct extension of Weingartner's horizon 
posture model -- was as follows: 
. e a 
maximize ee XK + Vp 7 Wr) ; 
subject to Base d.4*,+%- 4S D) 2%, , 
T ne t-1 t 
Prob( }) 2 a x= OF Va Ww ee ae < ys D,) >a 
ye ar j=l J i= J A= 1 
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u v.20 for Jt 2). she 
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7See Hillier and Lieberman mloG7 le pp. 530-42, for an introduction 
to chance-constrained programming. 
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where 


E is the expected value operator, 
D. is the amount of money supplied externally in period ay 
ae is the random variable representing net cash flow from 

project iti pee LOG mat | 

v7 is the amount lent in period t, 

we is the amount borrowed in period t, 

e is the borrowing, lending, and discount rate, 

] 

Xs is the fraction of project i TRNSESS STEEN SSA 

A 

d. is the expected horizon value of all post-horizon cash 
flows from project i, 

T is the horizon time. 


In this case, the probabilistic budgetary constraints are imposed on 

the cumulative net cash flows as adjusted for interest received or 

paid out. It is assumed that borrowing and lending take place on yearly 
contracts, and that these contracts must be negotiated prior to knowing 
PNem@eouccOmes iil seiies Despect1vemper 1 odcGeme [he rel OGoReaiiled oeno Ct sgoccrD Ic 
to guarantee with certainty that the cash flow constraints will be 
satisfied under all conditions. 


Assuming that the random variables, d, are independently 


Te 

, é : 2 : 
normally-distributed with mean Mig and variance ee we can derive 
a deterministic equivalent of the model wherein all investment and 


financing decisions are made at the outset (a zero-order decision rule 


which does not explicitly contain the random elements se 
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where F(:) represents the appropriate distribution function for each 
constraint. 

Had the random variables, 4y,, not been independent, the deter- 
ministic equivalent constraints would have included covariance terms 
Under tne1xy radicals. As Naslund pointed out) tnegmodel can ecasnly be 
extended to allow the oF to be normally-distributed random variables. 
Constraints expressing contingency and mutual exclusion relationships 
may, of course, be added as necessary. 

The terms above which involve square roots represent the financial 
slacks, or "cushions", which must be added to the expected net cash flows 
as a precaution against the possibility that the actual realized flows 
might violate the budget constraints. As intuition would indicate, the 


sizes of these financial slacks are increasing functions of the cash 


flow variances and the required probabilities, a, . 
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CHAPTER 2 


THE MULTI-STAGE MODEL 


2.1. Basis for the Model 

The model which we will propose in this chapter is an extension 
of the "basic Ewotdeace model" for chance-constrained capital budgeting 
which was presented in Hillier [1969]. Hillier's model was designed to 
facilitate a strategy approach to the selection of future projects as 
well as those currently available. In the two-stage context, certain 
decisions are made immediately (stage 1) with consideration given to 
investment opportunities which will become availabie in the future, 
and then a second set of decisions will be made in the future (stage 2) 
after having observed some of the results from the first set. This 
type of formulation not only can provide guidance on which future 
Hives tment ss snould@be sellectCed@goivem specific outcomes Frome tiie srrest 
group, but also can indicate whether the previously selected projects 
should be reduced, continued, or expanded. In general, the model can 
be set up to handle any number of stages, but for purposes of exposition 
we will confine most of our discussion to the two-stage case. 

Using the notation of Hillier [1969], the general problem is to 


wer § \. whose zero-one elements 
le: 3 m/ ? 


determine a decision vector, & = (5 
imdicate, the rejection or acceptance, respectively, of their associated 
projects. The determination is to be made so as to maximize the expected 


net present value of the portfolio, subject to probabilistic constraints 


on net cash flow in each period and on cumulative net cash flow through 
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each period. In addition, it is required that & be a member of the 
set of feasible decision vectors, designated by S. This set of véctors 
may be limited by Sete Weve lus fon Or contingency relationships among 
projects, and may also reflect additional constraints of a budgetary or 
non-budgetary nature. We further assume that the arguments of the 
probability functions and the restrictions on S can be expressed 


as linear inequalities. 


Lo ste cariOlalerorm stich problem@is Jao 


m0 
maximize E{P(5)} = Oe. 
jm iS 
; i= 
subject to Prob{(NCF), > LJ 2a, oh eee ee afi: 
Prob{(CNCF) | ga Ci) 21 EC a — Cee! - 
oS) ee oe =O) one le OT lee I 


where P(S) is the net present value of the portfolio, P is the net 
poesent velluehol project aye (NCF), is the net cash flow from the 
projects in period k, (CNCF) is the cumulative net cash flow through 
period k, Ly and Cy are the bounds imposed in period k, and O 


and ula are the specified risk levels in period k. 


ee The Basic Two-Stage Model 


Hillier's “basic two-stage mode 1" , which was mentioned previously, 


can be presented as a specific form of the general problem stated above. 





We augment 6 with another decision VecEors A= (4), oe At), defined 
in the same way, where each A. indicates the acceptance or rejection 
of a project available at the beginning of the second stage. These 
second stage "projects may include new investment opportunities as 
well as possible changes in the commitments which were made at the 
outset. Examples of the latter possibility might be to increase the 
funding of a research and development effort undertaken at stage one, 
or to undertake at stage two a project which was Oo iy rejected 
but is still available. Since these alternatives require previous 
acceptance and rejection, respectively, we would have to include the 
appropriate contingency and mutual exclusion constraints in the defini- 
tion of the feasible region for (8,A), which we designate by S'. 

The additional information which becomes available at the end 
of the first stage will normally include the values of the first- 
period cash flows from the accepted stage-one projects, and may also 
include the values of economic or business indicators such as the 
gross national product or Dow Jones Industrial Average. By dividing 
the set of all possible outcomes of the relevant additional information 
into a manageable number of mutually-exclusive and exhaustive subsets, 
and associating probabilities of occurrence with these subsets, we can 
develop a single optimum specification of 6& and a different specifica- 
tion of A for each stbset. This is’the strategy approach to which 
we alluded earlier -- the solution procedure specifies a group of 
projects to be undertaken immediately, and also delineates a plan for 


subsequent action based on the initial results from these projects. 


Ig 
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Using Hillier's notation, we can describe the subdivision of 
the gutcome set in more formal terms as follows: Let V_ be the 
random vector whose elements are the random variables of interest 
which will be observed at the end of the first period, and let n 
be the number of elements in V. Let R_ be the range space of V, 
so that R is that subset of n-dimensional Euclidean space whose 
elements are all the possible values of V. This set, R, is partitioned 


R e 


imeo nm mutually-exclusive and exhaustive subsets, R R arene 
ic at ee ie « 
E 


We then let 


Py, = Prob{V € Ry} for 9¢ =— las no 


For each of the random cash-flow elements (except those which occur 
in the first time period) , we require the determination of probability 


Gusiertoutlons €ond1l10ncds on the oeceurGgence Of the various subsets, Ro 


The final step is to generate a a4) corresponding to each subset 


R,, to indicate the appropriate decisions if V €R,; and to specify 


ee 2? 


a single 6 which indicates the unconditional first stage decisions. 


Therefouep the two-stage problem LS SEO 


n ? 
yO IN 
maximize ELP(S,4)) =92% P)S. + 2 6, WP E(PS ’) AL? 
i J J g=1 j=l J 
subject to Prob{(NCF), > L,} 2a, 
(2) x= & etl; 
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(2) ‘a ET 
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where (ncr) 4) and (once) (*? are the eee eeeaod net cash flow 

and cumulative net cash flow, respectively, corresponding to the event 

vec Ro 
As was noted elsewhere ©, a prime consideration in the partitioning 

of the outcome set R is that the points within a given subset should 

be as similar as possible in their effect on the second stage Geciisions, 

but the effects of points in different subsets should be as dissimilar 

as possible. These general guidelines are sufficient to illustrate 

the mode: formulation, but obviously the actual construction of such 

a partition may be a very difficult task. It is paradoxical that the 

second-stage effects! of the various’ points in R and, consequently, 

the necessary number and sizes of its partition subsets would only be 

known with certainty if the model were solved with each of these points 

considered a different subset. eevee even assuming we were able to 

accomplish this, we would then have no need to undertake the partition- 


ing: Obviously, no problem of practical size with a large number of 


elements in R (perhaps even uncountably infinite) can be solved 


ST Tier Lissa) pa 


rot 


point-by-point with a reasonable amount of computational effort. It 
therefore becomes incumbent upon the analyst to rely upon the judgement 
and intuition of management in determining the assignment of points (or 
regions) to subsets, and the number of these subsets must be limited 
by considerations of computational requirements. 

Although the restriction on the number of subsets may lead to 
a relatively coarse partitioning of the outcome set, and there may be 
difficulties in deciding in which subsets the various members of that 
set belong, this procedure should nevertheless provide much more guidance 
for future decisions than would a more common single-stage analysis. 
Should sufficient information about future investment opportunities and 
possible outcomes be available, and should computational requirements 
be reasonable, the formulation can be extended in a direct way to 
three or more stages. 

i De tomehis point, we have paid no attention to nonlinearity in 
the deterministic equivalents of the chance constraints on cash flow. 
(A brief discussion of these equivalents was presented in Section 1.4.) 
In the absence of simplifying approximation techniques, the computational 
complexity of nonlinear programming methods would quickly render all 
but the smallest multi-stage problems too time-consuming for solution. 
Fortunately, Hillier [1967] has enjoyed Significant success in developing 
both uniformly tighter and uniformly looser linear approximations to 
chance constraints under relatively nonrestrictive assumptions, and 
Seppala [1971] has developed alternative uniformly tighter linear 
approximations fur a special class of chance constraints. A thorough 


discussion of these approximation techniques and the associated 
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solution procedures is beyond the scope of this presentation. Suffice 

it to say that the general procedure is to solve two different integer 
linear programs (one with uniformly looser constraints, and the other 
with uniformly tighter constraints), and then to attempt a _ reconcilia- 
tion of any differences between the solutions while requiring feasibility 


with respect to the original nonlinear problem. 


2.3. Extension for Uncertain Future Opportunities 
With few exceptions “ie programming models for capital 
budgeting have been based on the assumption that the decision-maker 
is faced with a group of projects which are currently available or 
which definitely will become available for selection at a specified 
time in the future. Under this assumption the single-stage formulations 
require that all decisions regarding current and future opportunities 
be made immediately, while multi-stage formulations produce decisions 
on current opportunities and contingency plans for the selection of 
the remaining ones. The inaccuracies inherent in predicting the 
characteristics and the availability Oe future investment opportunities 
have led many writers to incorporate acditionales rather vartaliciale 
constraints on the firm's future financial posture. These constraints 
were used as a means of guarding against the possibility of being 


unable to undertake highly-desirable (currently unknown) future 


projects because of an excessive commitment of funds to current ones. 





Por additional discussion and afar tated t lem see Hillier PSS ialr 
pp. 46-51. 


ir - 
See Fisher [1930] and Weingartner [l966a], for example. 


Ls = ee . : 
7Hillier's "steady state” model ([1969], pp. 72-74) also qualifies. 
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The chance constraints discussed previously can be adjusted to help 
assure “adequate"(in management's estimation) liquidity; and the 
"portfolio payback" constraints aa "horizon posture’ constraints of 
BYES che al [lo71la,b] may be viewed as additional examples of this 
type of approach, However, it would seem more desirable to directly 
consider any information which is available on possible future 
opportunities, rather than to rely completely on such intuitive 
restrictions. 

Management may very well find itself in a position of possessing 
significant, yet incomplete, knowledge of specific projects (or types 
of projects) on which decisions may be required in the future. This 
information may relate to whether or not the opportunities actually 
will arise, when they may be available, what levels of participation 
may be offered to the firm, which of several cash flow patterns may 
apply (stochastic or debomninistae)s or any combination of these and 
other factors. 

The question of availability or non-availability certainly 
applies to research and development projects whose success may depend 
on the solution of specific technical problems or the development of an 
entirely new technology. This question may also arise if the firm 
relies on decisions of other organizations to Sentient either that 
fitmeeserv ices omethose of acompeti ton Obviously® anisuchaa 
situation, management may not be able to determine in advance that 
Pi owelevemrne first choice of a potential custqmermeaminally  tieue 
may be some possibility that the firm will not be allowed to undertake 


a particular project -- objections from its shareholders, restraining 


ody 





orders which result from competitors’ litigation, or anti-trust 
proceedings by the government may delay or prevent investment. 

The timing of project availabilities can also be affected by 
influences similar to those discussed in the previous paragraph. In 
fact, since non-availability may be viewed as an infinite delay, any 
factors which may have an impact on one may also affect the other. 

Participation levels may be determined by the availability of 
raw materials used in the firm’s product, the levels of participation 
desired by partners in a joint venture, the amount of services or 
products needed by a customer, the ability of the firm to successfully 
fulfill acurrent contractual obligation, diversification requirements 
levied by higher authority, or any number of additional factors. 

Finally, cash flow patterns may be influenced by such things 
as whether or not a competitor enters the field, the imposition of wage 
ORNPLicescontrols) by seevernment, the stime Peres, to successfully 
Marke agproduct, repair or weplacement costs! "for vital) machinery, 
peceplcion Of products by Chempup tire meters 

It is apparent that few analyses could successfully consider 
all the possible combinations of events which might influence the 
characteristics and availabilities of future projects; ra facts 
restrictions on model development time and the degree of computational 
complexity might limit consideration to those few possibilities 
which appear al priori to be most significant. However, even the 
incorporation of a limited amount of the type of information discussed 
above can allow the model to more realistically guard against the 


possibility of lost future opportunities. [It may still prove necessary 





to employ ae dG aay payback, or posture constraints to allow for 
the randomness of cash flow elements and the information which could 
not be considered by the model, but our proposed approach should 
allow less severe restrictions to be imposed, 

We will now present our proposed method for incorporating 
incomplete information eo a multi-stage model in the context of 
Hillier's "basic two-stage model", which was discussed in the previous 
section. A discussion of the special structure which is characteristic 
of both the basic model and our extension, and a brief presentation 
of a new integer programming decomposition algorithm for exploitation 
SoemiS@structare wilt); ollow inthe mext chapter: 

For the moment, we will consider only one subset, Ri» from 
among those into which the outcome set (R) is partitioned in the 
basic model. We assume that management has designated a total of 
h significant possible combinations of future projects which it 
desires seemcolci der "inthe: analysis" Ihab Use givenga total of oN 
individual projects which management believes may become available 
Eomee Meche *fUCureesthere sare oN potential combinations of these 
which may arise. Some of these cont net iene may be excluded from the 
analvsis because they contain projects which cannot possibly become 
available together, or because they fail to include certain projects 
upon whose availability that of some included projects is actually 
contingent. Other combinations may be excluded because their prob- 
abilities of occurrence are extremely small, or simply because giving 


explicit consideration to them would make the analysis too complex. 





Obviously, the decision of which potential combinations to incorporate 
in the problem formulation must be based on the experienced judgment 
of both managers and analysts. 


h) have 
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We further assume that probabilities qd. ( 1 eee 


been assigned to the events that the chosen combinations become avail- 
able. Instead of determining a decision vector (al?) har al 4)) as 
| ees 2S 


in the basic model, we will seek to determine a set of hh such vectors, 


£,1) oe : 
ame icc erudicatimg Chelopmrma 1 


; alist) fOr i=l 
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second-stage decisions which should be made in the event that V € Ry 
_th : , 
and the i combination becomes available. In order to accomplish 
this, we modify the objective function to include the additional 
decision vectors and the probabilities associated with the various 
combinations of projects; we also replace each of the en constraints 
which are indexed with 2 by h constraints indexed by (£,i) for 
i= LS eee 3 De 


With these changes, the problem is to 


nh 


m ve h m'( i) (0.4),.(8.4) 
maximize PLAC SR Eh E(P.)5. + 2 Py - Gee ECE ae 
jell J J =l1 i=l ise J 
subject to Frob{ (NGF), SS L,} 2 a, 
re k= rag coe y n; 
a 
prob{(NCF)< 3) 2 LJ >a, for £= 1, ... , a3 
as , om oe B 
ae, 
b{ ( N (5 1) oo f ay: : 
Prob (CNCF) | 2C J 21, 5 or =) 
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where S. represents the feasibWe region for (6,4) (exclusive of 


: : ach 
the chance constraints and integer requirements), given that the i 


combination of second-stage projects becomes available. The model 


can be further generalized by making L Cis hy and uy functions 


k? 


of £ and i, and by making Si GQecunee1 On JO: sere 


28 


CHAPTER 3 


STRUCTURE AND SOLUTION OF THE MODEL 


3.1. Size and Structural Aspects 

Assuming that all cash flows are deterministic or that the 
nonlinear chance constraints are replaced with appropriate linear 
approximations (as discussed in Section hor, our multi-stage model 
is an integer linear programming problem in binary variables. The 
number of these variables is an increasing function not only of the 
number of projects available at each stage, but also of the number 
of partitions of the outcome set and the number of possible combinations 
BeepEeieet avdilabilittessae each stage; beyond thes finstue im tact, 


using the notation of the previous chapter, the total is 


h 
N=m+n_ p ay, (ee) 

i=l 
for the two-stage model, which makes it obvious that the partitioning 
of the outcome set and the number of possible second stage combinations 
considered can greatly influence the model's complexity. With a three- 
Sitagesmodel> each of the nh second stage decision vectors would 
be replaced by as many vectors as were necessary to account for the 
possible second stage outcomes and the various combinations of third 
stage projects with might arise. So the number of stages is also a 
critical factor in determining the total size of the problem's decision 


Ve CilOln. 





The size of the constraint set depends on all of the above 
factors as well as on the length of the planning horizon (T) and 
the number of constraints necessary to define each of the regions 


P| "! 
S.. Assuming that each 5. requires) apcogal ofp s Beonstmaints {thils 


a 
number may actually vary with ip, and excluding the integer restrictions, 


the number of rows in the constraint set is 
M = n(h)(s) + 1 + 2(1-1)(n_)(b) 


for the two-stage model. This quantity is also highly-dependent on 
the number of stages in the model. 

When using enumerative-type zero-one integer programming 
fe ores @erne SOliETON eLrort required for most classes of problems 
tends to be more sensitive to increases in the number of variables 
than increases in constraint set sizes (excluding the integer constraints). 
LD cee Sede to thes fect iat the number (of binary@solutl om vectors maboch 
feasiblegand infeasible) is an exponential function of the numbersor 
variables (n variables result in aa possible combinations which 
must be checked, implicitly or explicitly). If linear programming 
is used as a Srembine devices uENeme [Rote required @ by the smmmlex 
method generally increases as a polynomial function (approximately cubic) 
of the number of constraints, but adding more constraints will often 
allow the linear programs to more rapidly eliminate infeasible or 


unpromising integer combinations from further consideration. [In 


I 
ee Geoffrion and Marsten [1972]. 
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addition, increasing the number of variables in a linear program tends 
to increase its solution time. 

Considering the potentially-exponential relationship between 
solution effort and the number of variables, it is clear that a method 
for decomposing a large integer programming problem into several smaller 
ones which can be solved independently could provide significant 
advantages. The large number of variables which result in the multi- 
stage model from partitioning the outcome sets at each stage and 
considering various combinations of project availabilities makes such 
a decomposition approach particularly appealing. Fortunate selec 
structure of the multi-stage model is readily amenable to decomposition. 

Consider the block diagram of a three-stage problem shown in 


Figure l. Blocks Ag) Ass and A, contain the constraint coefficients 


forthe first stage variables, blocks By through Be contain those 


for the second stage variables, and the remaining blocks (C through 


1 
Ce) contain the constraint coefficients for the third stage variables. 
For purposes of exposition, we have assumed that there exist two 
possible outcomes at the end of the first stage, and therefore have 

two groups of second stage blocks (B,-B, and By -Be) to represent 
the effects of these outcomes on the second stage projects. These 

two outcomes can represent either the preliminary results from projects 
undertaken in stage one, or two different sets of second stage projects 
which may become available for selection. Corresponding to each of 
these two first stage outcomes, we have indicated three possible second 


stage outcomes (this number was again chosen arbitrarily for purposes 


of exposition) whose effects are reflected in the "C" blocks. 
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The block labeled Ay represents the net cash flow constraint(s) 
for the first period, plus the mutual exclusion and contingency relation- 
ships among the first stage variables. The upper portions of each "B" 
block (along with the corresponding sections of blocks A, and Ay) 
represent the net cash flow and cumulative net cash flow constraint(s) 
for the second period as Sell as the interdependencies among first and 
second stage variables. The "C'' blocks are similarly associated with 
third period cash flow constraints and relationships among projects 

of all three stages. 

Assuming that n projects are available at each stage, we need 
6n decision variables for the third stage, 2n decision variables for 
the second stage, and n decision variables for the first stage. 
Therefore, with a total of Qn variables, there are pan possible 
solutions which must be implicitly or explicitly examined. 

Implicit enumeration algorithms search for the optimum solution(s) 
to a problem by successively fixing variables at either zero or one, 
After each such assignment, they attempt to determine whether or not 
fixing the remaining variables at their most favorable (easily ile) Zero- 
one values can result in an improvement over the best known Apia ae 
If the current assignment appears promising, the process continues by 
fixing another variable at zero or one. If the current one is ruled 
out, it is changed; commonly, this is done by finding thesmost recently- 


essipnedavariable whose alternate value hab mol beem tried setting 


Ehatavariapleval its falternate value, and then dismesarcding all asarenments 


1 


See Geoffrion and Marsten [1972] for a discussion of the techniques 
used. 





which were made after the one just Stead The process is non- 
repeating, and terminates when no untried alternatives exist for the 
variables in the assignment list. 

By imposing a priority ordering on the assignment process dis- 
cussed above, a significant reduction can be achieved in the number of 
enumeration-tree nodes for our multi-stage mod eee Specifically, we 
will divide the model's variables into groups, with all variables in 
a given group representing decisions at the same stage. It will then 
be demonstrated that assigning appropriate priorities to the groups 
and requiring that all variables in a given group be fixed before any 
assignments are made in a lower-priority Ee tp seat greatly enhance 
the efficiency of any implicit enumeration algorithm applied to our 
model, Referring to the group numbers indicated in the objective block 
of Figure 1, it is easy to see that assigning specific values to the 
n variables in group one reduces the remainder of the problem to two 
completely independent problems of itn variables each. For any given 
assignment of the variables in group one, each of the enumeration trees 
for these two problems has ae terminal nodes. Since there are 2” 
possible group one assignments, the total number of terminal nodes for 
the entire problem is reduced by this technique from 27n to ao 
ee a pene 

The above approach can also be applied to the solution of the 
two independent subproblems which resulted from assigning group one. 


For example, if all of the group two variables in Figure 1 are assigned 
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This is the LIFO (Last In-First Out) rule. 
Bicenrare [1973] has also discussed the approach wl.ich we employ, and 
has noted its applications to several classes of problems. 


3h 





Voucseeecitc Tirsteofethe two subproblems is further decomposed into 
three independent subproblems corresponding to groups four, five, and 
six. With 2” different specifications of the group two variables, 

and ae possible specifications for each of the other three independent 


an terminal nodes to consider instead of th 


groups, we have a new total of 3.2 
previous a Applying the same procedure to the second subproblem, 

we finally reduce the total number of terminal nodes for the 

entire problem from mn to 6-2". ee eae = 627 ee The 
significance of this reduction is made even more apparent by considering 
Specie valtes Of mM ={- with nu — o Che Tati osogemcm pn to pan 

is approximately 1 : 3, 690. Increasing the value of n to 5 
results in a ratio of approximately 1 : 178, 956, 970. This comparison 
makes it quite obvious that the decomposition procedure can greatly 
reduce the required solution times for problems derived from the multi- 
stage model, and thereby allow the solution of large, realistic problems 
which might otherwise be unassailable. 

The author has developed additional techniques for reducing the 
computational effort required by problems of the type discussed above, 
and has implemented them in a decomposition algorithm for zero-one 
problems, A complete discussion of this algorithm and the experimental 


results obtained with it will be presented in Chapters } through 6. 


3.2. Inclusion of Borrowing/Lendinge and Fractional Investments 
NN A tC EA Sy PSPS SNP repens seam, 


As we discussed in Chapter 1, capital budgeting problems may 


well include opportunities for borrowing and lending funds and consider 





projects which may be undertaken at any level from minor to full 
commitment. While it is possible to approximate such situations with 
sets of zero-one integer variables (each variable representing a given 
fRactaonerot 1s Bee ocar ed eine men c opportunity), proceeding in such a 
manner can greatly increase the number of integer decision variables 

and the solution effort ae for the problem (as discussed in the 
preceding section), It is normally preferable, therefore, to represent 
such decisions by continuous variables. 

Unfortunately, the solution procedure which we outlined above 
runs into some serious difficulties when an attempt is made to allow 
continuous decision variables in the model. With all decision variables 
restricted to zero or one, the value-assignment alternatives for our 
enumerative procedure are quite clear; but when we allow one or more 
variables to have an infinite number of possible values, and when the 
values of these variables will have effects beyond the Stage at which 
they must be fixed ( for decomposition), the question of where to set 
these variables becomes rather difficult. To illustrate this point, 
we refer to Figure 2 below. Figure 2 is a block diagram of a two- 
stage problem with two second-stage possibilities (subproblems) , and 
indicates the variables and matrix entries associated with the blocks. 
The decomposition procedure requires us to specify values for variables 
and then to address separately the two independent 


x and 


12 *o» op 
subproblems which result. Assume that x and x are zero-one 


2 


variables for which we have chosen specific Values sand thai 


1s a continuous variable such that O< ee l. To decompose the 


z 


problem, we need to choose the best setting of x relative to the 
2 


Pg 


DO 





9 
maximize E(P,) + E(P,) + E(P,) i my E(P,) 


subject to 





Figure 2; Two-Stage Problem 


assigned values for xy and Xn The exact determination of this best 


setting under most circumstances requires the solution of a mixed-integer 


programming problem involving x, and the second-stage variables -- 


y 


exactly the problem we are trying to avoid through decomposition. 
Fortunately, there are several cases in which the proper choice 
of x is immediately obvious, even without solving the mixed-integer 


3, 


program mentioned above: 


1. i Te) ee oe 245 = NO). (a55, ase, As, a5) O, and 
444%] it aioX%s S b, ,then 
pf. Py > 917*1 > 419%97 
x = nin! lL. —e_—— 
5 | ts 2, | 
4 - 


Since the investment represented by x_ makes a non-negative 
2 


-, 


Gontrtibution to total profit End does no™ require “the use wor 


Schrage [1973], Pp. 475, refers to such possibilitaeeoin gener giecerms, 
but provides no specific examples. 





resources which may be needed by other projects, there is no 


reason not to accept it at the maximum level permitted by the 


fimst constraint. 


Talat E(P,) 2 0, a5, =O, fand sia a52) S O, then 


13 2379 9339 Aya) 


x, = l. Since the investment gives a non-negative profit and 


2 


has a non-positive consumption of all resources, there is no 


question of its desirability. 


ieee Lt E(P,) On 2. senor (ia as) > 0, and 


13 a3? “537 Ay) 


el 9 then x = [b 


441%, + A1oXo D 3 In 


jaa Reba A1p%1/ay,. 
this case, the investment is undesirable from the points of view 


of profit and consumption of resources in the last four constraints 


However, given the assigned values for x) and Xo y the first 


constraint can only be satisfied by accepting the investment 
at a level greater than or equal to that indicated. Since there 
can be no advantage in accepting at a greater Teve Wyene snd i1Cated 


One @Sebest,. 


inom Le E(P,) SvO) a gee O wand (a a5) >0O then 


237 8339 “ya 


x, = 0. Since the investment makes a non-positive contribution 


3 


to profit and requires a non-negative consumption of resources 


1b 


Pia tec Onctrainis tt ts .clearly wundesmeab le: 


Cases I and III are certainly the most interesting of the ones 
presented, since the other two describe investments which should be 


excluded from the analysis before it reaches the computational stage. 
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Two very common types of "investments’ which are included in cases I 

and Tih respectively, fare contracts for lending@oreborrowimg funds 

(x, indicates the amount transacted). For example, if the borrowing 
rate equals or exceeds the discount rate used to calculate present 
value, then borrowing is an unprofitable activity with prs) = O. 
Assuming, for instance, that the first, second, and fourth constraints 
of Figure 2 are on net cash flow, and that the first of these applies 

EO) cChie atest (cimesperiod whilegthesother two§apply to the gsecondg period, 


we have the following situation: a,,<0O, a = Oo his 


15 ae 25 43 


indicates that the money borrowed in the first period must be repaid 


> 0, and a 


Po SeCONG with interestouLt Che Chird and fifth icoustrarnrce ane 
on cumulative net cash flow through the second period (one such 
constraint for each possible first-period outcome), we have aE > O 
and 453 > 0 eee Use more money is repaid than was borrowed. Had 

our model included constraints on more periods, the additional net 
cash flow constraints would have had zero entries while the cumulative 
net cash flow constraints would have had positive ones. This meets 
the requirements for case III. Similar reasoning places lending 
activities in the category of case I. 

The results for cases I and III can easily be extended to allow 
for situations in which the applicable rates for lending and borrowing 
are decreasing and increasing functions, respectively, of the amounts 
involved. This is accomplished by having different decision variables 


represent the amounts contracted under the various rates. Since the 


decision variables in our model are bounded above by one, we would 





indicate the maximum amount available under a given rate by the value 
of the associated variable's coefficient in the constraint applying 
to the period in which the borrowing or lending will take aero The 
coefficients in the constraints for later periods are, of course, 
adjusted appropriately. The obvious solution then is to make commitments 
Gnder Ele moseealeractlvesratesmeilirsc = proceeding as fam as necessary 
(in decreasing order of attractiveness) to contract for the desired 
amount, “0 

There is one circumstance in which continuous-variable projects 
can be handled by the decomposition procedure, even if they do not fit 
in special categories such as the ones we have described. This occurs 
when the projects are associated with blocks which represent subproblems 
at the lowest level of decomposition. In this situation, we can 
specify values for all of the integer variables (and the continuous 
variables of types I and III which are needed for decomposition) 
before attempting to determine the best values for these continuous 
variables, Having accomplished this, we can use linear programming 
(an integral part of most enumerative algorithms) to optimize the 


resulting subproblems with respect to the continuous variables, 


53.4. Summary 
The capital budgeting model presented in this chapter is designed 
to provide a strategy approach to the selection and timing of risky 


interrelated investments when the availability of future opportunities 


1 : 
Aalternatively, Otc ourse > we could employ separate upper bound constraints 
on the variables. 


O . ss a r e P 
See Weingartner [ 1967}, pp. 168-172 for a discussion of such results for 
linear programs with separable convex objective functions. 
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is uncertain. The model employs chance-constrained programming to 
express the risk preferences of the firm over time, thus avoiding the 
difficult problem of constructing or postulating an appropriate 
utility function. With either deterministic cash flows or suitable 
linear approximations to the chance constraints, the problem reduces 
to one of multi-stage integer linear programming under uncertainty. 
The solution of this multi-stage problem can be accomplished using a 
decomposition approach which allows for the inclusion of borrowing, 


lending, and certain other types of non-integer activities. 


1 





CHAPTER 


THE DECOMPOSITION METHOD: GENERAL DISCUSSION 


Pelee Applicatifons of “the Method 

The algorithmic procedure to be described in this chapter is a 
refinement of the technique is ONE in Chapter 4 and also presented 
in Schrage [1973]. Although we have confined our discussion up to 
ae point to the development of an improved multi-stage model for 
capital budgeting, the proposed solution procedure can be applied to 
all pure-integer (and certain mixed-integer) programs with dual- 
angular constraint matrices. The class of such problems includes 
not only the multi-stage problems discussed earlier, but also (with 
appropriate column rearrangement) those with structures similar to 
that of Figure 3. Such structures often arise in problems involving 


interactions among several time periods, operating locations, or steps 








Figure 3: Example of a Dual-Angular Structure 


koa 





of manufacturing processes.©! Quite commonly, the linking columns 


(represented by blocks A, through A 


l in Figure 3) reflect 


N-1 
inventories of intermediate or finished products which may be transferred 
among activities or stored for future use. In such cases, these linking 
blocks may actually tie together more than two "production’ activities 


(as indicated by blocks: B through B in Figure 3) to ensure that 


1 N 


inventory balance constraints are properly adjusted for transfers of 
Maberlalseand products. in any case, by grouping together these lLink- 
ing blocks, as shown in Figure 4, we can obtain an equivalent formula- 
tion having the same structure as the multi-stage capt tell budgeting 


problems of previous chapters. In this example (as was also noted and 


lA 





— eee — << — a — ed 


Figure 4: Dual-Angular Structure Equivalent to Figure 3 


“DERE: [1969], Chapter 5, contains an excellent discussion of 


a 


Siac onsS Tieawitecm. SUGCIL INCeractions arise. 
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discussed in Schrage [1973]) the linking block itself possesses a special 
structure which may be exploited to further reduce the number of possible 
solutions to be considered. The general dual-angular structure, however, 
allows any arrangement of Merriciente in the linking block. 

OUD Proposed procedure asenot Feéstrictead im rts appiiedtionete 
any one of the various implicit enumeration algorithms which have been 
presented in the integer programming literature“, and is equally 
applicable to both binary and general-integer linear programs. For 
this reason, we will restrict our attention in the present chapter 
to explaining the reasons for the development of the method and to 
discussing its applicability to enumerative-type integer linear pro- 
gramming algorithms. The details of cur implementation of the method 
within the framework of a specific algorithm will be presented in 


the next chapter. 


4,2. Motivation for the Method 

The number of variables in a dual-angular linear or integer 
Program grows in direct proportion to i: number of diagonal sub- 
matrices in its constraint matrix (assuming an equal number of variables 
per submatrix). As was noted in our discussion of multi-stage capital 
budgeting problems (Section ee Ue the number of these submatrices 
increases rapidly with the combinations of possible future events and 
project availabilities being considered. The discussion also pointed 
out that the total number of enumeration-tree terminal nodes for an integer 


program is an exponential function of the number of its variables, and 
ral : 

See Geoffrion and Marsten [1972] for a comprehensive survey of these 
methods. . 


yl 








outlined a procedure for reducing the number of nodes which must be 
explicitly considered for dual-angular integer programs. This procedure 
requires that a priority be placed on specifying values for those 
20 ae Losec Wwiel oOms pec lt heaem | CaUCc sHemt cCialndem OLmLiicmprovlLem 
to two or more separate subproblems which can be optimized independently. 
The same approach can be applied to these subproblems (and their 
descendents) if they also possess a structure which is amenable to 

such decomposition. 

The number of rows in a dual-angular problem's constraint matrix 
also increases proportionately with the number of submatrices added to 
it. Therefore, any algorithm whose time requirements are highly row- 
dependent may run into significant difficulty with such problems, even 
if the number of enumeration-tree nodes considered is reduced by the 
above decomposition procedure. After a given group of linking variables 
is completely specified and its associated subproblem (or main problem) 
is decomposed into separate subproblems, this difficulty can be 
alleviated by operating in only that portion of the constraint matrix 
which corresponds to the particular subproblem being optimized. However, 
if the number of linking variables is large, a great deal of work may 
need to be done in the full matrix before decomposition occurs. 

Most successful enumerative algorithms employ linear programming 
asga Lathoming deVice, as am aidgin determining thessequence in wuich 
the variables are assigned, and as a means for choosing the assigned 
values. The amount of time required to perform pivot operations grows 
much faster than linearly with the number of rows in the constraint 


25 


matrix. In addition, auxiliary calculations required for the enumeration 





o% 
?A cubic dependence seems to be generally accepted. 


Ls 


. 





scheme, such as the derivation of penalties, may also require dis- 
proportionately larger amounts of time as the number of rows increases. 
Although it may be possible to restrict pivot operations and auxiliary 
calculations to the appropriate submatrices after a problem is decomposed, 
this will require additional bookkeeping and recoding of available 
algorithms. Even if this is accomplished in an efficient manner, the 
problem of additional time requirements remains up to the point of 
decomposition, 

Our method is designed not only to greatly reduce the number 
of enumeration-tree nodes which must be considered for dual-angular 
integer programs, but also to alleviate the aforementioned problem of 


disproportionate row-dependence, 


4.3. Description of the Method 

Our decomposition approach to the solution of dual angular 
integer programs may be considered a synthesis of Schrage's decomposi- 
tion chorea with a pre~solution relaxation which reduces the 
number of calculations required at each node of the solution tree.. 
Rather than re-optimizing at each ee a linear program corresponding 
to the jentine) constraint matrix, it is only necessary to re-optimize 
a number of smaller subproblems, as determined by the number of 
diagonal submatrices in the given problem. In addition, the complexity 
of auxiliary calculations required by some algorithms can be sharply 


reduced by this approach. 








Ese Schrage [1973]. 
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max d 
oe 
subject 
to 
= 
B 
Dy) 





Figure 5: Block Diagram of a Two-Stage Problem 


Consider the block diagram of Figure 5. Assuming one knows each 
subproblem's contribution to the vector c (i.e., the “allocation” of 
c among the subproblems), it is clear that this problem actually repre- 
sents three separate integer programs, on which we have levied the 
additional requirement that their final solutions must agree with respect 
to the decision vector x. It seems quite reasonable to expect that a 
relaxation of this condition would cause a significant reduction in the 
Gequired computational effort. provided@tiat one can ensure Ehatt the 
“condition will eventually be satisfied, Fortunately, this is quite easy 
to accomplish within the framework of implicit enumeration. 

Our solution procedure specifies that the requirement on x 
be dropped completely from the formal statement of the problem, which 
immediately decomposes into three unrelated and smaller integer 


programs. This relaxation can be seen as a special case of Geoffrion's 
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[1972] Lagrangean Relaxation technique if we first write the problem in 
the equivalent form shown in Figure 6. The identity constraints represent 
the condition to be relaxed, and we can accomplish this by moving them 

up into the objective function with Lagrange multipliers of zero. This 
condition is then reimposed one variable at a time by (1) insisting 

that all x-variables in a subproblem be assigned values before any 
assignments of the y-variables are made, and (2) requiring that correspond- 
ing x-variables in the various subproblems be assigned in the same order 
and to the same values, In effect, then, we solve the subproblems in 
parallel with identical x-variable (first stage) solution trees. This 
obviously results in an implicit retightening of the original relaxation 
as successive variables are set to the same values. When all of the 
e=variables have Veenm@iixed= thetrellaxaltion ik@irre levant, the@preblem 
decomposes of its own accord, and optimization of the independent sub- 
problems leads to an optimal solution relative to the given assignment 


of first stage variables. 


max 


subject to 





Figure 6: Equivalent Formulation of Problem in Figure 5 
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Of Course, Cheyesis a price that must be paid for prelate sete 
of computational complexity, and that is in our ability to fathom first 
stage nodes. Since the sum of the subproblem objective bounds will 
normally exceed the bound which could be obtained from the unrelaxed 
problem (it obviously cannot be less), it is quite possible that our 
method will require further one before a given branch of the solution 
bite Cisse a eCCOCi iz Cd as JUnpeom Sing doWweVver sone sean expect that thas 
disparity will be reduced as additional variables are fixed (the 
relaxation is tightened); and since most fathoming will tend to occur 
after several such branches, rather than at the beginning of the search 
process, the loss may well be minimal. Another mitigating factor is 
that a first stage node may be fathomed by infeasibility of an associated 
subproblem or by an excessive sum of subproblem bounds before all of 
the subproblems are updated to reflect the last variable assignment. 

If this occurs, it is unnecessary to update the remainder before back- 
Erackingeimechem@solutbometree), jebustsaving additronalstime @By using 

a heuristic ordering of the subproblems according to relative "tightness" 
SEesize OL ObJECLIVEmLUNCLION COECLLIClents sone can enhance Che prop- 
ability that fathoming will occur before all or most are updated. 
Information gathered during the solution process can be used to 

‘reorder the subproblems, either by the algorithm alone or interactively 
with an operator. ; 

It is apparent that this procedure places no restrictions on 
the type of algorithm which can be used to optimize the subproblems, 


except that the rules used for selection of first stage branching 


variables and directions must be changed to utilize information 
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generated from the various subprobiems. Most of the monitor lysed 
rules for these purposes (e.g., "greatest Penal ye D1 OF ity ec 
"least total infeasibility after branching") can be modified to resolve 
any differences in the selections indicated by the subproblems. For 
example, in a penalty-type algorithm, the proper branch can be deter- 
mined by considering the sums of each variable's up and down penalties 
in the subproblems and branching away from the largest sum, 

The first stage objective coefficients for a two-stage capital 
budgeting problem are determined by summing the coefficients corre- 
sponding to its subproblems, so the appropriate allocation of these 
coefficients among the subproblems of our relaxed version is obvious. 
In cases where no such natural division is known, one can be specified 
arbitrarily by the analyst. The development of guidelines for this 


procedure may be a fertile area for additional research, 





CHAPTER 5 


THE DECOMPOSITION METHOD: IMPLEMENTATION 


See ErOGuUC EL On 

To evaluate the Senened method gag penalty-type ampiiert 
enumeration algorithm was developed for application to two-stage, 
dual-angular, binary integer programs. The algorithm employs Tomlin's 
improved Paities> for fathoming and branch-guidance, and utilizes 
a LIFO (Last In - First Out) search strategy throughout. The LIFO 
strategy was selected for ease of programming, small storage require- 
NCHA eroteMees SUppoOnemor eiiterent reoptimizationwer tue) linear 
programs meivediad The algorithm also requires that all first stage 
variables be assigned zero-one values before any such assignment of 
second stage variables, 

As stated in the preceding chapter, relaxation into independent 
subproblems prior to complete specification of the first stage variables 
necessitates alteration of the commonly-used criteria for branch 
selection and fathoming. Two methods, eee respectively on surrogate 
constraints and sums of penalty-generated subproblem bounds, were 
Peis ed and tested. A full explanation of these methods is contained 
in this chapter, and a comparison of computational results is given 


in the next. 


“See Tomlin [1970] and [1971]. 


eonee Geoffrion and Marsten [1972] and Glover [1965] for discussions. 
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The reader may find it helpful to examine the simplifed flow 
diagram of the algorithm in Figure 7. Although many details have been 
omitted, the diagram illustrates the sequence of major steps and 
decision points in the basic algorithm, We will discuss these steps 
and various alternatives which may be applied to them in subsequent 


sections, and will refer back to this diagram for ease of exposition. 


5.2 Penalties 
Development of the concept of "penalties" by Driebeek [1966] 
Hhasmledsto a considerable amount of research in Enus area, and to 


27 


several successful integer programming algorithms, The concept 

Hs quite elementary, (but (provides ja gpowerful epol for estimating, the 
objective function effects of assigning integer values to currently- 
unfixed variables. This information can be used to specify the order 
in which variables are fixed and to indicate when the current assign- 
ment of variables must be changed to possibly produce a better solution 
than is already known. Use of this stopping rule helps avoid the time- 
consuming task of reoptimizing the linear programming problem for both 
branches on a new variable in order to recognize that an assignment 
change is necessary. In addition, when one of ies possible branches 

Ol a glvenevabiables will lead#to an infeasible or interior solution, 


penalties may indicate this fact and eliminate the need for such 


determination via the simplex method. 


et al, [1970], and Bénichouy €C wal. 
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alee DaAvinewet al: [1967], Roy 
[1970], for example. 
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Figure 7. Simplified Flow Diagram of the Algorithm 





Assuming that one is seeking to maximize the objective of a 
linear program, it is a relatively straightforward exercise to show 
that the maximum is a piecewise-linear concave function of any problem 
variable, The maximum of this function, as indicated in Figure 8, is 
attained at eee Va liuey Xs which the variable ze takes in the 
optimal linear programming solution. Information contained in the 
optimum LP matrix can be used to calculate the slopes of line segments 
a and b. Multiplication of these slopes by the distance between x 
and the appropriate ordinate gives the values of the up and down 
penalties, designated by Py and Po: As is made obvious by the 
diagram, subtracting the appropriate penalty from the value of Z 
gives an upper bound on the maximum objective value which can be obtained 


Lf Be Ws fixedeat Zero or one. (in this illustruation, z= Py is 


the exact value of max z subject to x, = i) 


max Z@ 


/N 





Figure 8. Graph of max z vs. x 





By calculating the up and down bounds for all basic variables 
in the optimum LP solution, determining the maximum of the two bounds 
for each variable, and’ finally finding the minimum of these maxima, 
we obtain an upper bound arte best integer solution to the problem 
(relative to the current assignment of zero-one values to the fixed 
variables). If this bound is ieee than the objective value of the 
best known integer solution, a change in the current assignment is 
obviously necessary (Figure fn hte 5). Given that the present 
branch is not fathomed in this manner, the various bounds can be 
compared with the best known solution. Any bounds which fail to 
exceed this value indicate that their associated variables must take 
on the opposite values if the current assignment is to lead to an 
improved solution. 

Assuming that a complete assignment of the variables has not 
been achieved and that the current partial assignment still appears 
promising, it becomes necessary to choose a new branching variable 
and a value for that variable. A heuristic choice rule which has 
been successfully employed is the following: Find the minimum 
among all up and down bounds ~-- then branch in the opposite direction 
on the variable achieving this minimum. The objective function bound 
‘on the branch in the direction of the minimum is stored (along with 
a description of that branch) for future reference (Figure (ee cen Le 

Tomlin [1970, 1971] presented two methods for the derivation 
of stronger penalties than may be obtained via the simple procedure 


GeccuLbed above, 8 Lie saunse Giothese methods uti) 2s See sect Chat 





forcing a fractional variable to an integer value requires that a 
nonbasic variable enter the basis from either its upper or lower etnd. <2 
Peaches eeilec ra Neevar lave Gis one gwhitch as required (Logbe anvanteger: 
then one can assume at least a unit change in its value for purposes 

of computing penalties. That is, two sets of penalties may be computed 
for each basic variable -- one in the manner described previously, 

and one which also assumes a unit change in the driving variable. One 
then uses the larger of the two penalties determined for each direction 
of change in the basic variable to calculate bounds, 

Tomlin has also shown that calculation of a bound based on a 
Gomory cut on the fractional variable results in one that is at least 
as small as the larger of the two improved penalty bounds discussed 
above. This "Gomory bound" can therefore be used as a more powerful 
fathoming test than is given by the minimum-penalty bound. A method 
for strengthening Tomlin's improved penalties even further, but at 
the cost of additional computational effort, has been developed by 
Arms tuone gand) Sinha’ | 1O73)% 

Our use of Tomlin's improved penalties in the algorithm is as 
follows: Given a partial assignment of the first-stage variables and 
an assigned value for the next branching variable. we proceed to 
reoptimize each independent subproblem with respect to the new branch 
(2 ieee 7s Le p 2). Each revised linear program's objective value 
replaces the previous bound for its subproblem, and the revised sum 
of subproblem bounds is checked against the best known solution. If 

Assuming the upper-bounding technique for linear programming is 


being used, a variable can be nonbasic at either its lower bound 
(usually zero) or its upper bound. 
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the branch is not fathomed, penalties are calculated for all non-slack 
basic variables, and a new subproblem bound is determined from the 
largest "Gomory penalty". This bound is also summed with the other 
subproblem bounds_and Heck a against the best known solution to the 
problem. We proceed to address each subproblem in this way until 
fathoming occurs or all are umeceds 

mi tnemease sof fathnoming, titehiprOmnuleeouidestse lection oF 
=e next partial assignment to be considered (Figure {, 2teP By). 
Otherwise, for each unfixed variable from the original problem, two 
quantities are determined. The first such quantity is found by 
summing over all subproblems the bounds given by each subproblem's 
objective and the down penalty associated in that subproblem with 
Ede vwatgiab legot interest aif in some subproblem, the) variablegis 
already at its lower bound, we use only the LP objective as a "down 
bound" from that subproblem. If the variable is nonbasic at its 
upper bound, we use its relative cost as a down penalty. The sum 
derived from this process gives a valid upper bound (assuming maximiza- 
tion) on the best integer solution to the given problem when all fixed 
variables are set at their assigned values and the variable of interest 
is forced to its lower bound. The eo quantity is calculated in 
‘a similar manner to estimate the total effect of increasing the 
variable to its upper bound (relative costs are now used as up 
penalties in those subproblems in which the variable is nonbasic at 
its lower bound), (Figure 7, Step 3). The variable with the smallest 


quantity of either type is chosen as the next branching variable, ala(al jelei= 


branch is made in the opposite direction from that sum, (This is 


aT 





analogous to the branching criterion which would be used if the problem 
were not relaxed into independent subproblems.) Of course, any variables 
whose bound sums force particular assignments are given those values 
and the reoptimiZation cycle is performed again prior to selecting a 
branching variable, 
After values have been assigned to all first stage variables 

and decomposition has occurred, the algorithm proceeds to solve each 
subproblem to its integer optimum (relative to the first stage assign- 
ment), (Figure 7, Step 6). The only special features employed during 
this phase of the procedure are (1) bounds obtained for second stage 
branches are added to the other subproblem bounds to see if the branches 
are worth considering (this is in addition to checks against the 
individual subproblem's best known integer solution), (2) as they are 
obtained, subproblem integer optima replace the bounds determined at 
the end of the first stage, and (3) naturally-integer LP solutions 
dpemutilized as they occurs 90t) at jany time @agsubproblem its found 
to be infeasible or the sum of subproblem bounds falls below the 
required level, the remaining subproblems need not be optimized. 
The algorithm then returns to make a change in the first stage assign- 
IMeCLLES- 

' Termination of the solution procedure occurs when the upper 
bounds of all unexplored first stage variable branches are inferior 
to the objective value of the best known integer solution. If no 
feasible integer solution has been found, the procedure may also 
terminate if no potentially-feasible partial assignment remains (all 


branches have upper bounds of minus infinity). Since there exists 
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a finite number of possible zero-one assignments to a problem's variables 
and the LIFO rule prevents repeated consideration of any such assignment, 


the algorithm will obviously require only a finite number of steps, 


5.3. Surrogate Constraints 


A considerable amount of research has been done on the develop- 
ment of logicaltests for fathoming branches without the time-consuming 
use of linear programming. Work along this vein was initiated by 
Balas [1965] and has been extended with varying degrees of success in 
Glover [1965], Balas [1967], and Geoffrion [1967,1969]. These latter 
studies have recognized the limitation that logical tests can be 
efficiently applied to only one constraint at a time, and have 
attempted to generate single constraints which capture some of the 
joint logical implications of two or more constraints considered 
simultaneously, Such single constraints, which serve in the place of 
multiple original constraints for logical testing, were dubbed "surrogate 
constraints" by Glover [1965]. Geoffrion [1969] has shown that the 
most powerful surrogate constraint is one determined by a weighted 
sum of the given constraints, where the weights are the optimal dual 
variables generated from a linear programming solution to the problem, 
By employing logical tests on such a constraint (and possibly some 
earlier ones) before and after selecting a branching variable, one may 
often fathom a current branch without further recourse to linear 
programming. Geoffrion [1969] has demonstrated that this approach 
results in significant reductions in the amount of computational 


effort required to solve a large variety of problems. 





As an alternative to the sum-of-bounds approach described 
previously, a method for utilizing surrogate constraints for fathoming 
and guidance of branch selection was developed for our algorithm, Our 
use of surrogate constraints differs substantially from Geoffrion's 
[1969] in that Balas-type logical tests are not employed and the con- 
straints are only generated during first stage branching. This should 
WOGebeeviewedgas 42 mejcction Ofesuchslocicalatests, butwmather as, a 
limitation imposed for the purpose of experimentation. The primary 
objective of our use of surrogate constraints was to determine whether 
or not they could provide an efficient means for regaining some of 
the information lost as a result of the relaxation to independent sub- 
Preblensees Spceitically Bvcesoupht to represientythe sct@of@couctraints 
for each subproblem by a single surrogate constraint and to reimpose 
the requirement that first stage variables have the same values in 
each subproblem. The surrogate constraints are generated as byproducts 
of the subproblems' linear programs (using the optimal dual variables 
to form weighted sums of the subproblem constraints), with objective 
rows being assigned zero weights. (The reason behind this assignment 
Of Zero weights§is' that} white one can insist that the ageregate of 
these objectives exceed the value of the best known integer solution, 
the value of any given subproblem's contribution to this sum is 
immaterial. ) 

A linear program is formed from the aggregate objective and the 
Sapo surrogate constraints, with corresponding first stage 


variables in the constraints and objective made identical once again 
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(Figure 7, Step 3). Solution of this surrogate linear program leads 
to a valid upper bound on the best integer solution which can be 
obtained from the current branch, thereby providing a supplement to 
the sum-of-bounds fathoming test described in the preceding section, 
aumince teat fathoming does not result immediately, penalties are 
calculated for the non-slack basic variables of the surrogate LP, and 
a revised bound is determined from the largest Gomory penalty, If 
fathoming still does not occur, the penalties are used to check for 
inadmissible values of unfixed first stage variables and to choose 
the next first stage branch. Once a sufficient number of iterations 
are performed to assign values to all first stage variables, a surrogate 
linear program can produce no additional information, and the naturally- 
decomposed problem is solved by independent subproblems as discussed 
previously, Had we chosen to supplement the solution procedure with 
logical tests, we would continue to generate surrogate constraints and 
to perform.the appropriate logical tests during the post-decomposition 
solution of each subproblem., 

As is discussed in the chapter on computational Spel Lenices 
the use of surrogate Linear programs proved to be more time-consuming 
than the basic sum-of-bounds approach for fathoming and branching. 
This may Demat least) pareially attributed to the mtacesthat the 
surrogate linear programs were used to supplement, rather than to 
replace, the penalties calculated in each subproblem. However, we 
conjecture that the time required to set up and solve these surrogate 
problems will generally exceed that which can be saved by suppression 


of subproblem penalty calculations. 
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5.4. Steps of the Algorithm 


The preceding discussion has explained the logic and rationale 
behind our solution procedure within the framework of the simplified 
flow diagram of Figure 7. While this presentation serves to locate 
and outline the most important steps of the algorithm,a more detailed 
discussion is necessary to adequately explain the sequence and inter- 
relationship of the various steps and to exhibit the more intricate 
mechanisms of the procedure. In addition, the following exposition 
will enable us to show clearly the alternative uses of penalties and 
surrogate constraints, and to point out some specific modifications 
which may be made in future efforts to improve the performance of 


the algorithm, 


O. We are seeking to solve the following zero-one integer 


linear program: 


5 ey ney 
e e d 
maximize — y y © 14 ie eae, 2 23 yO3 ; 
f=1 j=1 L=-1 j=1 
n 
Bye Ct ut Ome) ae ae for i=l I 
ie jar C8 4 > 08? Sie 550) 
ny "2g 
(CC) aera. DE cS ons Dee 
oem ype cei (ate = I) LL 
EO rt £= i ; ise se 1s Ly, 
(5) OSx, 1 for j=l... , ny, 
(4) OSs Jy jd for Zge= sb as Lees Mops 


(5) all variables integer , 
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where x and y represent first and second stage variables, respectively, 


We also have 


L = number of subproblems (diagonal blocks), 

ny = number of first Stage variables, 

No, = number of second stage variables in the ae. subproblem, 
ar = contribution to profit from subproblem £2 when first 


stage project j is undertaken, 


dy = profit from undertaking second stage project j in 
subproblem £, 
ian » 
64 j = use of 1 resource by first stage project j in 
subproblem £, 
met : aes 
Bij = US CeO rad. resource by second stage project j in 
subproblem £, 
Iy = mumber of resource constraints applying solely to first 
stage variables ("'subproblem zero"), 
I, = number of resource constraints in subproblem {2 
@ = 7; aoe 
and 
Boa = resource limitation of fee constraint in subproblem {f 
(£ = 0, ; L) 
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1, Relax the problem into independent subproblems by replacing 
each variable with Xp a Where Ps and eappend ine 


constraints (1) to each such subproblem (with appropriate subscripting 


of x). Further relax the problem by dropping the integer requirements 


given by (5). 


2. Initialize the solution procedure by choosing an ordered 
Sei 5, (usually empty) of first stage variables to be fixed, and 
assigning values of zero or one to these variables. If an integer 
solution to the problem is known a priori, set z* equal to its objective 


value and store the solution as the current best, Otherwise, set zZ¥ = -0, 


Go to step 4. 


4%. Choose a new first stage branching variable according to one 
of the following two procedures: 
a. Sum-of-Bounds: Consider, for each variable not contained in S, 
the sum of its up subproblem bounds and the sum of its down sub- 
-problen bounds as determined in step 6. Select that variable i 
Wie Che snd Wes tec Un Ome lt her ey pepercddd them ariab lemiamene 
ordered set S, and assign to all variables Xp (Ce. = eee 


the O-l value of - which is opposite to the smallest sum. 


Note the bound on the alternate branch on 2S 


be ourrogare LP Penalties; Among al¥ first stage basic variables in 
the last surrogate linear program, find the one with the largest 
«N 
up or down penalty, P. Add this variable, Xs, EOe THe Set ao mmdand 


assign to all variables or Cia eee eee me O- eva luc sok 


6) 


Xs which is opposite to this largest penalty. The bound associated 
“NN “~~ 
with the alternate branch on Be is 2 minus the larger of P 
d P 
an G’ 
If all unfixed first stage variables are nonbasic in the last 
StiniOC dbG@ue esc lect [he ones with lhe largest 1elativescosem Add 
thus yairlable; oe to S$ and assign to all variables Xj 


C= Ieeeeesiyeethe presemm value of 28 in the surrogate LP. 


3 3 


oN 
The alternate bound on a is Z minus its relative cost, 


nh, Select a subproblem to update with respect to the last 
variable assignment. Reoptimize this subproblem as a linear program 
while ensuring that all variables corresponding to members of S are 
nonbasic at their upper or lower bounds (one or zero), as appropriate, 


Eietkessubprobiem is Now infeasible. go torstep 1G; 


5. Replace the previous upper bound on an integer solution to 
this subproblem by the updated LP objective z (if smaller). If the 


sum of all subproblem bounds is now less that zx, go to step 10. 


6. Calculate penalties for all unfixed first and second stage 


Venables dodmaclermine: iaie Blar les CaG@onOlm pena lite Pp. 


GC" Replace the 


bound for this subproblem by Zz 2 If the sum of all subproblem 
bounds is now less than z2*, go to step 10. Otherwise, perform one 


of the following two operations, as required by the option chosen in 


step 3: 
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a, Calculate and store both up and down subproblem bounds for each 
fixed first stage variable, For basic variables, the bounds 
are given by z minus the respective penalties. For nonbasic 
variables, zero and the relative costs serve in place of penalties, 


ana DouUnGs are Calculiaised as for baste Variables. 


b. Using the optimal multipliers from step 4, form a surrogate constraint 
as a weighted sum of the subproblem's given constraints, and store 


this constraint, 
Ti alisubproblems have mot been updated, return to step 1. 


fs @ttall finst stage wariables have been assigned values .§¢go 
Eo suep Ti If not, and option (a) has been chosen in steps 3 and 6, 


go to step g. 


8. Form a linear program from the subproblem surrogate constraints 
determined in step 6(b), reimposing the identity of corresponding first 


stage variables by suppressing the first subscript in each aye 


(C2 See L). The objective function for this surrogate LP is 


3 3 


that of the original, unrelaxed problem (sum of subproblem objectives). 
Set all variables in S at their assigned values, and solve the 

“N 
Serres dtce ee tt tile GpLimum Ob jective Vallee 2 aars fess Claimec 


Sr the problem is infeasible, so to step LO 7 Otherwise | determine tne 


“™ 


largest Gomory penalty, P among the basic first and second stage 


G? 
“~ os 

Variables. Jf 2-)P. <2 go to step 10. If fathoming still ives 

HOfsoccucrred, Calculate up and down penalties for all basic first 


stage variables. 
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9. Using one of the following two methods, check for currently- 

unfixed first stage variables which must take on specific values if 
the present partial assignment is to lead to an improved integer solution: 
a. For each variable, check the sum of its subproblem up bounds and 

the sum of its subproblem down bounds from step 6(a). If both 

bounds are exceeded by 2%, the current assignment is fathomed -- 

go to step FO. Otherwise, set fall variables having one botind less 

Phat co @eeemencli albernate values se add (che Jasci gnments memos 


Nere tChatetne alternate sbprancnes are fathomed, ands Beturnaee 


step 4. 


b. Using the surrogate LP penalties and relative costs from step on 
“NS 
calculate up and down bounds from z _ for all unfixed variables. 
For all variables with bounds less than 2z*, assign their alternate 


3 


Values in S, Note EnatbethiesotLnereprancnesearc fathomed, and return 


to step h. 
If no additional variables are fixed in this manner, return to step 5. 


10. The current assignment of first stage variables has been 
fachomedws RGferrineg to (Ene—gordered gse= sis tocate thegmos Eerecently— 
added variable whose alternate zero-one assignment has not yet been 
investigated, and whose associated bound exceeds 2%, Assign the 
alternate value to this variable and indicate (by setting its bound 
to -w) that both assignments have been tried. Delete from S all 
variables which were added subsequent to the one being reassigned, 


and go to step 4. 
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If no variable is reassigned in the above manner, terminate, 
The best integer solution currently in storage is optimal. If no such 


solution is stored (z* = -~), the problem is infeasible, 


Ti. Select the next subproblem, 2 (2% = 1 L), to be 


3 ee @ , 3 


solved to its integer optimum (relative to the first stage assignments 
in S). Set 2° = -~, If all second stage variables are naturally- 
integer in the last LP solution to this subproblem (step 4), go to 


step li. Otherwise, go to step 16. 


l2, Choose as a new second stage branching variable the one 


having the largest, P*, of the up and down penalties calculated in the 


3 
last LP solution. Set this variable to the zero-one value opposite 


to ee add the variable to S, and store the bound on its alternate 


value (given by the LP objective, z, minus the larger of P* and the 


largest Gomory penalty, Ea 


13. Reoptimize the current subproblem LP while ensuring that 
all variables in S are nonbasic at their upper or lower bounds (as 
appropriate). If the subproblem is now LOL eds D te een COes Ceol 


1p eee ZK Z 


g» 8° some I 5 CLS z* = -o sum Zz with the 


L , 
bounds associated with all other subproblems. If this sum is less 


than z* (the best known integer solution to the entire problem) , 


OD Beows Ce pay 


14, Lf all second stage variables have been assigned values 
SEeeseectimment Lb’ Solution isi naturally-rmteger thrs sorwvtion is 
stored as the best known integer solution to the subproblem. In this 


case, set z" = Z and go to step l7. 
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15. Calculate penalties for all unfixed second stage variables 


in the current subproblem, and determine the largest Gomory penalty, 


Bc Perform tests (1) and (2) of step ie Usine Z - Bo in place: of 
ze 


16. Determine bounds by subtracting each non-slack basic 


variable's up and down penalties from rae and subtracting each non- 


slack nonbasic variable's relative cost from z. If Zz f£ -00, 


compare these bounds with Zz 


the sum of bounds for all other subproblems. For each variable having 


otherwise, compare with z* minus 


a bound less than this amount, assign its alternate zero-one value, 
add the variable to S&S, and note that the other branch has been fathomed. 


ic@yariablés aregrixed in this manner, return @re tstep l5, sotnerwisar 


return to step le, 


17. The current assignment of second-stage variables for this 
subproodlem has been fathomed. Locate the most recently-added variable 
in” S whose alternate assignment Nas not yet been investigated, and 


whose bound exceeds 2z* If z* = -%, compare the bound with z* 


Li) £ 
Minus the current bounds from all other subproblems, Set this 
worl able" bees ateerno we valuc: indicate that both assignments have 
been tried, delete from S all variables added ‘subsequent to this 
Griemeeald So OMEOmcceD Lae 
If no variable is reassigned in this manner, the best integer 


solution in storage for this subproblem is optimum relative to the 


assignment of first stage variables, and Zz is the bound to be 
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70 









ll. Subproblem 
selection : 














Forward 
branching 





28 





LP solution 
not naturally 












integer_ 13. Update 


subproblem 


14>) Gurnent 











improved | LP solution 

3 ;solution to integer ? 

2 | subproblem 

= No 

“4 

5 

= 15. Penalties 

a8 

fy 

| Forced 

eo ees branch fee ch 
Vv No forced brane 
17. Backtracking Branch 


chosen 


No branch chosen 









Current 
subproblem 
integer 
solution 
found ? 





No, Curwent firstestage 












Yes, Store 
subproblem solution, 








All 
subproblems 


solved ? problem solution. 







Yes. Store improved 





No 
Figure 10. Second Stage Flow Schematic of the Algorithm 
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associated with the subproblem. If 2 / ln comcomscep Lie mre ey a1 


4 


the assignment of first and second stage variables in S gives an 


improved integer solution to the problem. Set z* = 
£ 


als 


Ae and return 
1 
to step lo. 


If no integer solution to the current subproblem is in storage 


= -o©), the subproblem is integer-infeasible. Return to step 10. 


5.5. Possible Modifications to the Algorithm 
The literature of integer programming is Beh in techniques 
which may be used to supplement or replace many of those used in the 
specific implementation described above. It would be well beyond the 
scope of our discussion to present a listing and discussion of these 
methods. Since the main body of our contribution is the technique for 
relaxation to independent subproblems and decomposition, rather than the 
penalty/ surrogate LP approach used to implement this technique, we 
refer the reader to any of the recent surveys and texts in the fe aie 
There are several tactical considerations involved in the 
application of our implementation which.may lead to reductions in 
solution times, For example, if the option to use surrogate linear 
programs is chosen, it may prove more economical to form a new surrogate 
LP less often thameat each »iteration of step 6. This would eliminate 
much of the time spent in setting up the problems and finding initial 
feasible solutions (simplex method, Phase iO 18a addition, when a 


Sigler come itiGeO pate ge aniaimaimies 1S Used tor several aterations, 





“Isee, for example, Geoffrion and Marsten [1972] or Garfinkel and 
Nemhauser [1972]. 
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restarting techniques can be applied to update previous solutions, 
thereby saving time which would otherwise be required by Phase II of 
the simplex method. The tradeoff in this approach derives from the 
fact that "older'’ surrogate constraints may not be as strong as newly- 
Created ones, thus resulting in reduced fathoming ability. 

As mentioned in Section 5, surrogate LP's were used to supplement 
the fathoming test of step 6, which utilized Gomory penalties for each 
subproblem, Considerable savings might be realized from eliminating 
the calculation of subproblem penalties and relying more on the 
fathoming power of the surrogate linear program anameles penalties. 

In addition, it would be quite easy to apply Balas-type logical tests 
to the already-available surrogate constraints when working on the 
assignment of first stage variables. Use of these tests when assigning 
second stage values would require explicit formation of the surrogate 
constraints from available data -- not a difficult task. 

No attempt was made to identify and utilize any naturally-integer 
first stage variable values in the subproblems or surrogate LP. Provided 
all subproblems agree in their assignment of integer values to unfixed 
first stage variables, it is possible to fix all such variables and 
peoceed) Eom: Hep #1 me rheregis, oF course, no guarantee that a naturally- 
integer first stage assignment in a surrogate LP will be feasible for 
the individual subprobiems, and we conjecture that an attempt to use 
such assignments will be less successful than one based on subproblem 
solutions. ° 

As pointed out by Schrage [1973], one of the disadvantages of 


a decomposition approach such as ours is that the necessity of assigning 





values to all first stage variables prior to working on the second 

stage can lead to wasted time. This can be true if the values of 

several first stage variables are relatively "unimportant" in the final 

solution. Schrage has suggested that the flexible tree-search technique 

introduced by Tuan [1971] can be used to partially alleviate this problem, 

Given that one has identified some of these "unimportant" variables, 

our subproblem relaxation can provide some help in this area. If it 

is suspected that the current assignment of first stage variables 

cannot lead to an improved integer solution (regardless of what values 

are given to the currently-unfixed "unimportant" variables), we can 

suspend the restriction that all first stage variables be assigned 

values before any second stage variables are assigned, Branching on 

the second stage variables while leaving the "unimportant" first stage 

ones free in each subprobiem may lead to faster fathoming. Unfortunately, 

it is not clear just how such "unimportant" variables can be recognized, 
Finally, we have insisited thal, after fixing all first stage 

Vanlab lec meachimcuccessive Suppropmenpspe Solved sromoptimal ley soelone 

the next one is considered. This can be excessively time-consuming 

if several subproblems contain some "unimportant" variables, since the 

varivus values of these variables wocrd have to be considered before 

proceeding to the next subproblem. The approach might be improved 

by allowing partial optimization of successive subproblems in an 

attempt to verify infeasibility of the first stage assignment or to 

determine that the assignment cannot lead to an improved objective, 

If the attempt fails, the method can return to complete the optimiza- 


tion of each subproblem. 
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CHAPTER 6 


COMPUTATIONAL RESULTS 


6.1. Computer Code 


Evaluation of our subproblem-decomposition algorithm was carried 
out on an IBM 360/67 computer, using a woes in FORTRAN IV 
by the author. This program was designed to facilitate experimentation 
iii dk LOUS sallernat ives eand@thereiore tie sesults presented Wiercin 
should not necessarily be considered representative of those which 
might be obtained from a professionally-encoded production version. 
In order to provide a means of comparing the relative effectiveness 
Beet PLOcecaULe the Codegwas designed CO Operate imeamy OF Cie 
following three modes: | 
Pe CCOmpOS le Lou meson LNdependent Ss ubprob lemsaoe elene rao tL aelic 
two versions of our algorithm (sum-of-bounds or surrogate LP) 
as described in the preceding chapter. 


2. Decomposition without First Stage Relaxation -- addressing 


Ehe Orlcina) prob lci tO Rmulte Ole witht  aepEiOricy olf Liroe 


40 


stage variables. 


No Decomposition -- straightforward solution of the problem 


LN 


without exploitation of structure. 
Mode 2 is derived from mode 1 by simply not specifying that the values 
of corresponding unfixed first stage variables are allowed to differ 
among the subproblem LP solutions. By dropping the requirement that 
Tk ae 


The decomposition method used by Schrage (1973), and discussed in 
Seetion 4.1. 
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all first stage variables be assigned zero-one values before any such 
assignments are made to second stage variables, we obtain mode 3 from 
mode 2, 

The linear programming portion of our code was based extensively 
on a primal-simplex LP code with product-form inverse known as LPM-1, 
which was written by J.A. Tomlin of the Systems Optimization Laboratory, 
Depaaiment ot Operations! Research, Stantord University. 9bhis program 
was modified to use the upper bound technique for dealing with unit 
upper bounds on all variables, and appropriate subroutines were added 
to permit operation as a dual-simplex method as well. Reoptimization 
after forward branches was performed with primal-simplex pivots, whereas 
the dual-simplex method was used upon backtracking when a previously- 
optimal solution was available, The remainder of our code was written 
in functional modules according to the various tasks to be performed 
(Seance sielec tilonpeapenatiyecalemlarton mites cine so. ipolnds) etcar with 
a main program to coordinate the application and sequencing of the 
various modules, The final version of the program was compiled under 
IBM's FORTRAN-H compiler with the object-program optimization option 
employed at level two. While dimensioned to handle up to 10 subproblems 
@iecOs rows ‘each with 2O%first Be rie and lO second stage 
variables per subproblem, the object program required approximately 
192 K bytes of main memory (with all instructions and data in-core), 

Various options were built into the code to allow monitoring 


of solution paths, penalties and bounds calculated at each node, 


methods of branch selection and fathoming, and identification of 
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improved integer solutions. However, the results presented hexein 

are of runs in which all such intermediate output (except for description 
of improved solutions) was suppressed. The solution times which we 

PCP Omte alcupasce@sonatnic total time during which the CPU was available 

to the core partition containing the job, excluding 1/0 wait time 

and the time required to load the object program anddatain from disk 


SOLE ape, 


6.2. - Description of Testing Procedure 


The primary objective of the testing program was to determine 
the solution-time dependence of our algorithms on the number of sub- 
problems and constraint rows in a variety of test problems. This was 
accomplished by formulating a set of six ‘master" problems, with each 
such master composed of at least eight subproblems. By deleting various 
numbers of subproblems (and their objective function contributions) 
from each master, additional problems were derived and solved, Test 
problems obtained from any given master had the advantage of containing 
ma yete CNicH Gidracteristicsofgthelr sources andgwere therefore closely 
related in terms of computational Pomel ty) This relationship 
made it possible to directly compare the solution times for problems 
of increasing Sh zeweand to attribute sthemresultsvor such comparisons 
largely to the influence of size. Had we chosen to compare the solution 
times of totally unrelated problems of various sizes, it would have 
been necessary to generate a rather large sample in order to average- 


out the variations in complexity among problems of equal size. 
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Limitations on time and funds would necessarily have restricted our 
investigation to fewer types of problems if this latter alternative 
had been chosen. ~ 

Civenmamispeciticemaster @problem andgats derivatives @the procedure 
followed was to solve each member of this set using one or both variants 
Of our decomposition algorithm. Using the solution times thus obtained 
as a standard, modes @ and 5 of the preceding section were then applied 
to successively larger problems from the set until their time require- 
ments grew to be excessive or all problems were solved. As will be 
shown in the sections dealing with each problem set, mode 1 proved 
to be clearly superior in all but a few of the smaller problems (with 
the sum-of-bounds variant outperforming the surrogate LP approach). 

The sum-of-bounds variant of our algorithm experienced such a 
slow growth of solution times with problem size in the first six sets 
that a rather large test problem (30 subproblems vs. the usual 8-10) 
was generated and run in various sizes with mode 1. This was done in 
an attempt to determine if the growth rate would increase significantly 
as the number of subproblems was enlarged beyond the limits of previous 
runs. The absence of such acceleration appears to be very promising 
for the solution of large-scale problems by our subproblem-decomposition 
algorithm. 

Phew el oth, 0d sina Seton tect apmob lems was selected—rrom 
a group derived by Schrage [1973] from a problem known as IBM-1 
(Haldi [196]). Each of these problems consisted of two subproblems 
having an equal number of rows and of second stage variables, and 


differed only in the number of first stage (or linking) variables 
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retained from the master problem. Even with such a small number of 
subproblems, our algorithm proved clearly superior to each of the 
other two methods tried, and showed a more consistent dependence on 


the number of linking variables than did Schrage's procedure, 


6.3. Test Problem Number One 

The master of our first test problem set was formulated from 
the data of an R&D project selection problem (Number 5) devised by 
Petersen [1967]. The original problem represented a group of 28 
projects by a measure of profitability and their budgetary requirements 
during each of ten years. In order to obtain a problem with the 
structure for which our algorithm was designed, we first divided 
each of the original projects into two separate ones of five year's 
Guration cach. That sis the first five rows @f Che constragit matrix 
were taken to represent one group of 28 revised projects, and gtheglast 
five rows represented a second group. Each objective function 
ec rte wentawas divadedg by 1O°wrounded upeeo tne mcaresc even integer : 
and then split equally among the two projects formed from its column, 
By alternately listing one project from each group, we obtained a 
collection of 56 columns of five rows each. 

The first six of these columns were chosen to be the first 
stage matrix entries in each of the subproblems of the dual-angular 
structure being built. The remaining 50 columns were divided 


sequentially into 10 groups of 5 columns each. These ten groups 





were used as the diagonal submatrices representing the second stage of 
sum best problem, WReterrine testhe notation of Kaxecure 5 in Chapter I, 


each of the submatrices A, (i=l 10) consisted of the 5 rows 


3 ee @ ) 
and 6 columns of the first group of revised ~peojeciss | and each 

B. (i= 1, ... , 10) was a 5 X5 submatrix representing one of the 
remaining groups of 5 projects each. Each element of the first stage 


OS EEE ce Se consisted of the sum of the identical cost rows 


10) 


3 ? 


associated with each A. (Gm 1. oe ; 


and each d. was the 
second stage cost vector associated with the corresponding Be 
(i=l, ... , 10). The right-hand side (RHS) of each of the resulting 
50 constraints was determined by taking approximately 70% cf the sum 
of coefficients in each constraint (Petersen seems to have followed 
the same rule for determining the RHS of his original problems). 
The cost and constraint coefficients for each of the 20 sub- 
matrices in test problem number one have been tabulated along with 
Ene depeegate Lirst@stage cost vector, €,9in Tabie A-I ingthe appendixy 
Five ditferent derivatives preblemsemconsisting OF (Ehemiinst san 
subproblems (n = 2, 4, 6, 8, 10) of the master, were solved using 
both versions of the subproblem decomposition algorithm. Attempts 
were also made to solve the first Four of these problems with mode 2 
Bee mee ode Wand ether ri Esitmehree were: addresisedswith mode 5 - = [he 
results of these efforts are shown in Table I and are plotted in 
Graphs I and II. "Total Nodes Explicitly Considered" refers to 


those nodes of the enumeration tree whose associated assignment of 


values to variables was actually made in the course of the solution 
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Table I 


Results of Test Problem Number One 





NUMBER OF SUBPROBLEMS 
2 4 6 8 10 


Algorithm 







Ver Lant 







Total 





Sy = .O2 11.29 29.60 27.84 
Vales 3.21 19.38 oe 6 60.38 
1.41 10.03 118.48 > 300 








Time in 





Seconds 









Total 1) 51 ilgge h6u. 38h, 
Nodes 18 BS 169 460 384, 
Explicitly 20 59 366 
Considered 7 eee 15 

DSB = Mode 1: Sum-of-bounds variant 


DSSC = Mode I: Surrogate LP variant 
DFM = Mode 2 


NDFM = Mode 3 


process. Those nodes which were not analyzed explicitly because of 
predecessor nodes being fathomed are excluded from this count. Each 
of the algorithms was allowed to take advantage of the fact that all 
costs were integers by rounding all upper bounds obtained on various 
branches down to their closest integer values before testing for 


fathoming. 
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6.4. Test Problem Number Two 

The second test problem's master was formulated from the data 
of Petersen's 5 x50 Problem 7 in a manner similar to that of the 
preceding test problem. Instead of chootiat the first six columns 
as first stage variables, we randomly selected 10 of the 50 columns, 
discarded the first 4 of these, and used the remaining 6 as linking 
variables, The other 40 columns were then divided sequentially into 
8 groups of 5 and used in 8 diagonal submatrices (second stage). The 
original objective function coefficients were retained for all variables, 
and the RHS was once again determined by taking approximately 70% of 
each row sum, 

Thegten randomly-selected columnsgwere li; oe oe 
2D. Bor HO. and Hqmmeemne coct and constraint eoelriciencs of each or 
the 16 submatrices of test problem number two have been tabulated 
along with the aggregate first stage cost vector in Table A-II, 

FOUL Md time ren tEadiceriva tive problems @comsictin? ii Chest 1s aug 
subproblems (n= 2, 4, 6, 8) of the master were solved by both 
versions of the subproblem decomposition algorithm. The first three 
of these were also solved with modes e@ and 3, and an attempt was 
made to solve the fourth using mode oe The results are shown in 
Table II and plotted in Graphs III and IV. Once aod LTS Lie eae lel 
costs were integer, rounding was performed on all bounds before 


attempting fathoming. 
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Table II 


Results of Test Problem Number Two 


Algorithm NUMBER OF SUBPROBLEMS 


— Variant | 


Total Ie. Sey G; SBS 

Time in 16.99 46.86 

Seconds on Speeeeale. oO 
SNS 21.28 


Total 
Nodes 
Exner e mt ly. 


Considered 





6.5. Test Problems Three and Four 

Since our decomposition algorithm was initially designed to be 
applied to a class of multi-stage capital budgeting problems, it seemed 
highly desirable to use some test problems representing this class, 
Unfortunately, we were unable to find any dual-angular capital 
bodoetine sproblems in the [reerature, so a matrix generating program 
was developed to produce "projects’ with random cash flows from 
specified ranges. The first two such test sant were designed 
with 4 first stage and } second stage variables per subproblem, and 
the number of possible first stage outcomes (subproblems) was set at 
10. These 10 outcomes represented 5 different general states (bad, 
foliose rdse 2O0d, excellent) with 2 possible sets of available 


second stage projects for each such general state. 
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The matrix was generated by first choosing for the "average' case 
4 first stage project cash flow sequences as random integers uniformly 
distributed over the ranges shown in Table III. The first element of 
each such sequence was designated to be an initial "start-up" cost 
for its associated project, and was then added to the second element 
to give total first-year cost for the project. The remaining elements 
mone then wsed as net icash tlows for years 25)5e)and 4 (all projects 
ae a fixed life of four years), The next step was to generate 
second stage projects in a similar manner, except that they were 
designated to begin during year 2 and extend through year 5. The 
second set of possible second stage project availabilities for the 
"average’ case was determined by choosing the first two such projects 
MEOm EMcefinst set and generating two mew ones a therefore s there 
were two projects which would be available in either case at stage 
Cwo, 

Having accomplished the above, we were in possession of all the 
constraint coefficients needed to represent the "average case (sub- 
matrices AL/ Ae, op and Be). The remaining four cases were derived 
from this "average case by adding randomly-selected increments (or 
decrements) to each element of the 10 distinct projects, except for 
the first-year cash flows of first stage projects. These integer 
increments and decrements were chosen from uniform distributions over 
the ranges shown in Table III. 

Probabilities for occurrence of the five major states were 


ChOS¢ MEO Demme © alge ally OlComeand Ome cespe; clive lyaerrom bad - 


he 
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Table III 


Test Problems Three through Six: Parameters 










Increment Case and Range 





Time of Initial 
F Low Range 









Bad Fair Good BxcelLrene 


Start-up [-40, -25] 

Year 1 [-25, 0] | [-9, -3] [-7, 2] [-2, 7] . (3, 9] 
Year 2 [-25, 0] | [-9, -3] [-7, 2] [-2, 7] [3, 9] 
Year 3 [ 50, 50] | [-9, -3] [-7, 2] [-2, 7] [3, 9] 
Final Year [ 20, 40] ; [-9, -3] [-7, 2] [-2, 7] [3, 9] 


to “excellent’., Within each of these state swpEOvapl ries on O.4 and 
0.6 were assigned to the two possible second stage project availabilities, 
yesulting im probabilities of (0.0), 0.06)°07068 0.12, O16 8072k> 0.03, 
0, Uae OOS, 0.06) for the ten subproblems. Objective function “weights” 
were determined for the subproblems by dropping the decimals in these 
probabilities and dividing by their greatest common denominator (2). 
The subproblem objective function coefficients were then determined 
by summing each project's cash flows and multiplying by the appropriate 
objective function "weight. 

The final step was to determine a RHS for each constraint in 
the "average’ case by adding 35% of the sum of its positive coefficients 
to 65% of the sum of its negative ones, The RHS's thus obtained for 
the two project-availabilities were then averaged and rounded, and 
this final set of values was used as the budgetary limits (RHS) for 
every subproblem, All constraints were "greater-than-or-equal-to" 


inequalities. 
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The cost and constraint coefficients of test problems three 
and four are listed in Tables A-III and A-IV. 

Each of these two problems was run in five sizes formed by 
successively removing the subproblems corresponding to the bad, 
excellent, fair, and good outcomes, in that order, All 10 problems 


were solved with modes 1 (sum-of-bounds variant), 2, and 5 of our 


3 
algorithm. The results of these efforts are presented in Tables IV 


and V and in Graphs V - VIII. Rounding of all bounds down to nearest 


integers was employed throughout. 


Table IV 


Results of Test Problem Number Three 













Algorithm | NUMBER OF SUBPROBLEMS 

Variant | 2 yy 6 8 10 
Total DSB 1:05, le Oligo. 50 2795 5 Se 
Time in DFM Vel 322i Ds 09 9. Ome Lt. GP 
Seconds NDFM 1325 (ee Ome aL Ge 
Gotal all Eg 
Nodes DEM 22 28 28 36 1O 
Expliert ly NDFM 29 
Considered 


Table V 


Results of Test Problem Number Four 








Algorithm NUMBER OF SUBPROBLEMS 

War vane Qo ); 6 8 10 
Total DSB ao aso ls el 206 
Time in DFM poe Oe (ee 15. cCOM 22.25 
Seconds NDFM [57 2.7m O.60. 52.000) 61795 
Total DSB 9 16 22 29 38 
Nodes DFM 12 agl pul 39 HO 
Explicitly NDFM 8 2); 69 163 269 
Considered 
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ergor Test Problems Five and Six 

The very encouraging results obtained by our subproblem decomposi- 
tion algorithm (DSB) in problems three and four, especially the somewhat 
less-than-proportional increase of solution times with the number of 
subproblems attempted, led to the formulation of two more such problems, 
The main difference in these additional problems was that they were 
designed with 5 projects in each stage instead of h. The same matrix 
generator and parameters (Table III) were used along with the same 
probabilities for each of the 10 subproblems. The only difference in 
procedure was that the RHS was calculated using 45% and 75% (vs. 35% 
and 65%) of the positive and negative constraint coefficients, 
respectively. The objective and constraint coefficients of these 
problems are presented in Tables A-V and A-VI. 

These additional test problems were run using the same algorithm 
Vaulants applied seomehe@precedi ng Ewompand Sth ec sactulbem ares Saiven 1 
Tables VI and VII and Graphs IX - XII. Integer objective coefficients 


again allowed all bounds to be rounded down to nearest integers. 


6.7. Test Problem Number Seven 

Exper lencemwini mt Gm tC cit said kena: discussed above (especially 
problems 3-6) indicated a marked tendency for the solution times and 
node counts to increase approximately linearly with problem size when 
the subproblem-decomposition algorithm (DSB) was applied. In retrospect, 


Siarewresult.15 not particularly surprisimg since Che algorithg largely 


gl 





Table VI 


Results of Test Problem Number Five 





Algorithm NUMBER OF SUBPROBLEMS 


Variant o in O 8 10 
Total DSB 1,48 2.59 ope 5.06 5.00 
Time in DFM ew 7.07 28.06 Sileeis (c(0) clap 
Seconds NDFM 1.79 19.29 44.08 166.30 -- 
Total DSB 29 ail 34 7 45 
Nodes DFM 25 Syl 139 183 128 
Explicitly NDFM 26 194 288 818 -- 
Considered 

Table VII 


Results of Test Problem Number Six 


Algorithm NUMBER OF SUBPROBLEMS 
Variant 


Total 
Time in 
Seconds 


Total 
Nodes 


Exe 2c Ly 


Considered 
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ignores the interrelationships among subproblems and treats each addi- 
tional one as a separate integer program to be solved in parallel 
weenethemrest, In effect, doubling the seotalesize of a problem requires 
not the periodic solution agi a linear program which is twice as Pal cee 
but the periodic solution of twice as many linear programs of the same 
size, The same relationship holds true with respect to calculation of 
penalties and performance of the various bookkeeping and overhead 
operations. The fact that the last four problems gave rise to more 
consistent results than the first two may be attributed to the formers' 
similarity among subproblems, as was noted in Section 2 of this chapter, 
Such similarities would be expected in "real-world" multi-stage capital 


budgeting problems, which our matrix generator was designed to simulate, 


’ 

In order to obtain additional information on the relationship 
between problem size and computational effort with our algorithn, 
the matrix generator was used to produce a large problem (30 sub- 
problems) with characteristics identical to those of test problems 3 
and 4, Each subproblem consisted of 6 rows (including the objective), 
4 first-stage variables, and 4 second stage variables. The problem 
was run in 8 different sizes using the subproblem-decomposition 
method (DSB), and the results are wives in Table VIII and Graphs XIII 
igs, 4A 

The outcome of this additional test series obviously reinforces 
our contention that the subproblem-decomposition algorithm will 
generally experience a linear growth of solution time with problem 


size when applied to dual-angular structures of the type herein 


eornsidered Mespecially af there exists & similarity or consistency 





Table VIII 
Results of Test Problem Number Seven 


NUMBER OF SUBPROBLEMS 
2 6 10 en 18 22 26 30 





Total Time 


in Seconds 





Total Nodes 
Explicitly 8 12 15 Ol Be, 46 50 5) 


Considered 


among subproblems. Additional testing of this hypothesis on a wider 
range of problem types would of course be desirable, but indications 
are that the method will provide a viable technique for the solution 


of large-scale dual-angular integer programs. 


6.8. Schrage's Test Problem 


When applied to the two-subproblem versions of our first six 
Fese problems, Che subproblem-decomposition algorithm obtained results 
quite similar (and sometimes inferior) to those obtained by modes 2 
‘and 3 of the code. Despite the fact that the algorithm's relative 
efficiency could be questioned at this lower level, it was decided to 
apply the method to a selection of 5 of the 8 test problems devised 
by Schrage Dleirasy |. The main purpose of this investigation was to gain 
insight into the behavior of the three algorithm modes as we 


increased the number of linking variables (first stage) while holding 
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the number of subproblems (two) and second stage variables (fourteen 
per subproblem) constant. 

Since there existed no natural allocation of each first stage 
variable's objective coefficient among the two subproblems, equal 
division was arbitrarily specified. Rather than doubling the resulting 
subproblem objectives to obtain integer costs, we chose not to enable 
the bound-rounding feature used in previous runs. In addition to other 
tactical differences between our algorithm and Schrage's, this lack of 
rounding in our runs renders any direct comparison of solution times 
or node counts with Schrage's reported results meaningless. We there- 
fore base our conclusions Be ley) tet the relative performances of our 
algorithm's three modes, and draw no conclusions concerning the 
efficiency of our method vg Schrage's. 

The results reported in Table IX and shown in Graphs XV and XVI 


indicate that the subproblem-decomposition algorithm again outperformed 


Table IX 


Results of Schrage's Test Problem 










Algorithm NUMBER OF LINKING VARIABLES 
Variant 5 S fe) ; 
Total DSB Missi ST auigs alee | ecole 
Time in DEM Cy aGmeeet7 00 552000 7o.o7 
Seconds NDFM 19 (Cou! © 5200 muooeos 
Total DSB 
Nodes DEM 
Explicitly NDFM 


Considered 
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both other methods, but with a fairly constant ratio of solution times. 
The increase of solution times with the number of linking variables is 
approximately linear with each method, particularly that of subproblem- 
deccmposition. It us) also interesting to note that the method without 
decomposition (NDFM) had a higher node count than the straight decomposi- 
tion method (DFM) in only one instance, and that its solution times 
were consistently better. This might be construed as indicating that 
Schrage's problem(which has only two subproblems) is not particularly 
amenable to such decomposition, and might therefore explain his some- 
what mixed results with it. 

The results of this test series give no reason to conclude 
that decomposition loses its effectiveness as the number of linking 


Variables if increased. 


6.9. Summary of Computational Results 

Results obtained from the previously described testing procedure 
strongly indicate that the subproblem-decomposition algorithm enjoys 
significant advantages over the other two methods tested. The solution 
times experienced with this method ee quite commonly 50 - 80% below 
these obtained from mode 2 (DFM), which also relies on decomposition 
via priority specification of linking variables but performs all its 
Operations on the full problem matrix. In the majority of cases with 
PUREE Sueai Cesteproblems, beth of these algorithms have provided 
much better results than a straightforward method taking no advantage 


of structure (NDFM). Comparison of the node counts obtained with 
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DSB/DSSC vs. DFM indicate that, rather than causing decreases in 
fathoming ability, the separation of subproblems actually may result 

in an improved capability to recognize unpromising first and second 
stage branches. [It is pale ven that the obvious weakening of objective 
bounds which occurs when subproblems are uncoupled is often compensated 
by the advantage of using nacht ee rob lene largest Gomory penalty 
rather than a single such penalty taken from the full linear programming 
tableau. The advantage of having strong bounds for each subproblem 
seems to be particularly pronounced after a problem has decomposed 
naturally and integer optima are sought for the independent subproblems, 
Reference to steps 13 and 16 of our algorithm (Chapter 5), WHEsen Se) 
will clarify the reasons for this claim. 

The surrogate-LP version of our algorithm consistently required 
more time and considered more nodes than its companion sum-of-bounds 
approach. A separate timer was placed on that portion of the code 
which set up, optimized, and calculated penalties for the Surrogate LP 
The time required for these efforts accounted for approximately 50-85% 
or the) additional solution times for DSSC vs. DSB. “Ine remaining 
time can be attributed to consideration of additional nodes. As was 
discussed in Sections 5.3 and 5.5, there exist several possible methods 
for reducing the time required by our surrogate LP option and enhancing 
its fathoming capabilities; however, it is doubtful that such procedures 
can give this option a significant advantage over the sum-of-bounds 
approach, 

Our algorithm's approximately linear growth of solution times 


and node counts with problem size (as determined by the number of 
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subproblems considered) make it an extremely promising technique for 


the solution of large-scale dual-angular integer linear programs. 
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CHAPTER 7 


CONCLUSIONS AND AREAS FOR FUTURE RESEARCH 


(eee Capigal Budsecine Formulation 

ppm PLesemied mm Chap tere >) Our vex tenedor soi shih erer Gebas le 
two-stage model to allow consideration of uncertain future availability 
of projects adds another dimension of realism to a promising theoretical 
technique for the solution of multi-period capital voudgeting problems. 
In the past, many mathematical programming approaches to capital 
budgeting have relied on an assumption that all present and future 
investment opportunities (within the time frame being considered) 
could be identified and incorporated in the analysis. The applicability 
of such techniques to "real world’ situations has been limited by that 
assumption because, in most situations, very few possible future events 
can be regarded as being "certain" to occur. In an environment of 
uncertainty, one can impose constraints on future cash positions to 
provide a source of funds for possible investment in desirable 
Opportunities which might arise. This type of approach is rather 
artificial because it requires that the amounts to be kept available 
DerdceCiImined OlGside on Lhe Ssolulionmeprocesss.o, the model @ernerepy 
reducing or eliminating explicit analytical use of whatever partial 
information on future events may be available. 

At the price of expanding Hillier's model and increasing its 


computational COP | ccae ye we are able to incorporate some of this partial 
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information directly in the analysis. This is accomplished by relaxing 
the aforementioned assumption to require predictions of which projects 
may become available and estimations of their associated DEObDaD iste verse 
ieeptdcl 1 Co morscoursSe miconsideration) would@be given sonly to chose 
projects, or combinations of projects deemed to have the most influence 
on a model's behavior. 

Requirements for predictions of possible investment opportunities 
and estimations of probabilities demand additional management input 
to an analysis and more thorough understanding by analysts of the 
uncertain environment which they are attempting to idealize. Philosoph- 
iomey SPCakiig  stits: 1Seaivery desirabllessecondary benckrGger ati lyzing 
the proposed approach, From a more practical point of view, solution 
of a large model with explicit consideration of future uncertainties 
should produce much more useful results than would the independent 
precessing of a large number of small problems based on rigid assump- 
PIOUS a2bOtGethewtuGure mG iVCHmEnat sthes latter approach sm@ tak cresone 
is left with the formidable task of resolving a single "best’ course 
of immediate action from a set of indications which may differ con- 
siderably because of their underlying assumptions. This problem is 
even more difficult in a capital mereer it context, wherein many or 
all decisions are of the “accept-reject" variety, and therefore not 
amenable to compromise. 

Having argued the case for a more refined and computationally- 
complex analysis, it is necessary to address the problem of solving 
the resulting formulation. We believe that the subproblem-decomposi- 


tion method presented in Chapters 4 through 6 will prove lo be a very 
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efficient technique for the solution of that class of PIECSEr Wpeoerams 
which includes our formulation of multi-period capital budgeting with 


uncertain future project availabilities. 


7.2. Subproblem-Decomposition Method 


The computational experience reported in Chapter 6 strongly 
indicates that our technique of "uncoupling" column-linked subproblems 
and then using an enumeration procedure to gradually retrieve the 
original problem structure is quite efficient for the solution of 
dual-angular integer programs. Our specific implementation of the 
method within the framework of a penalty-type algorithm resulted in 
substantial improvements over both of the other previous ly-~developed 
techniques which were tested. These improvements were noted not only 
in total solution times, but also in the numbers of nodes explicitly 
considered by the various methods. Of equal, or perhaps Sueetcis 
importance is the approximately linear growth of solution times with 
the number of subproblems that was experienced with the subproblem- 
decomposition algorithm. Assuming that this observed behavior is 
indeedwcharacteristic of the relaxaltion procedure, the computational 
tractability of large-scale dual-angular integer linear programs 


will be determined mainly by that of their component subproblenms. 
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7.3. Areas for Future Research 

The field of capital budgeting contains many unresolved problems 
for both finanetal expen t sland operations researchers. Development of 
procedures for determining the complex interrelationships among 
investment proposals and incorporating these into valid mathematical 
models, especially when non-linearities and discontinuities are 
inven yedem niet 10S additional study. The same is true of methods for 
incorporating attitudes toward risk into mathematical idealizations 
of the decision process; present practices generally fall into two 
categories -- those which are acknowledged to be somewhat artificial 
but relatively easy to implement (e.g., chance-constrained programming) , 
and those which have a sound theoretical foundation but cannot be 
readily obtained or employed (ome. utility functions). Mlisiogy Ehe 
difficulty of determinine a firm's exace “cost oi capital for use in 
analysis may be at least partially avoided by developments in the area 
of post-optimality sensitivity analysis for integer programming. 

We have already given considerable attention in Chapters } 
and 5 to possible alternatives and modifications in our subproblen- 
decomposition method, As mentioned previously, the method can be 
applied within the frameworks of most popular implicit enumeration 
algorithms, and it would be desirable to obtain indications of its 
effectiveness in a number of different procedures, In particular, the 
surrogate constraint algorithm developed by Geoffrion [1969] appears 


to be quite efficient and would be a prime candidate for synthesis 


with our method. Additional development of the use of subproblem 





surrogate constraints and surrogate linear programs might well prove 
to be a fertile area for research, It should also be noted that, 
although we have restricted our discussions to problems involving 
binary variables, the method can be extended in a direct way to deal 
with general integer variables. 

The majority of test problems used in this study have had 
equally or nearly-equal numbers of first and second stage) variables 
oer subproblem. Although such a situation would be common with 
capital budgeting problems, other types of models (such as those in 
which’ stages do not correspond to successive time periods) may not 
eos 6S SeSUCMmces ( GWetULeC emer Olstlis Feason Mes woulds be Mater es Gimg 
to consider a broader range of test problems of two and more stages. 
In particular, the behavior of our method in two-stage problems when 
ENemuUMbDeR sor Second stage varrables ise eradually reduced (Col Zero meen 
it remains successful, would indicate that problems with many rows 
might be solved more efficiently if first relaxed to a number of 
smaller "subproblems’ and then reunited by the enumeration process. 
The question of how to assign subproblem objective coefficients in 
such a situation (and others in which no natural allocation exists) 
also deserves serious attention. 

In Chapter 3, we discussed four cases in which continuous 
decision variables appearing prior to the completion of a problem's 
decomposition could be handled with little difficulty. We also 
pointed out that continuous variables which appear only in the final 


level of decomposition create no problems for the decomposition 
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approach, Obviously, the development of techniques for employing 
decomposition in problems with general continuous variables not covered 
by these cases would be of tremendous value for solving dual-angular 
mixed integer programs. 

Finally y= ior other types of structured integer programs, “1E 
is hoped that the success of our technique will kindle greater interest 
in pre-solution relaxations which are progressively retightened as 
the enumeration process evolves. We suggest the block-angular structure 


with linking rows as one to which such a technique might be applied. 
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